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Preface 


Analysing and designing systems with the help of suitable mathematical tools is 
extraordinarily important for engineers. Accordingly, systems theory is a part of 
the core curriculum of modern electrical engineering and serves as the foundation 
of a large number of subdisciplines. Indeed. access to specialised areas of electrical 
engineering demands a mastery of systems theory. 

An introduction to systems theory logically begins with the simplest abstrac- 
tion: linear, time-invariant systems. We find applications of such systems ev- 
erywhere, and their theory has attained advanced maturity and elegance. For 
students who are confronted with the theory of linear, time-invariant systems for 
the first time. the subject unfortunately can prove difficult, and, if the required 
and deserved academic progress does not materialise, the subject might be down- 
right unpopular. This could be due to the abstract nature of the subject. area 
coupled with the deductive and unclear presentation in some lectures. However, 
since failure to learn the fundamentals of systems theory would have catastrophic 
repercussions for many subsequent subjects, the student must persevere. 

We have written this book as an easily accessible introduction to systems theory 
for students of electrical engineering. The content itself is nothing new; the theory 
has already been described in other books. What is new is how we deliver the 
material. By means of small, clear explanatory steps, we aim to present the 
abstract concepts and interconnections of systems theory so simply as to make 
learning easy and fun. Naturally, only the reader can assess whether we have 
achieved our goal, 

To aid understanding, we generally use an inductive approach, starting with an 
example and then generalising from it. Additional examples then illustrate further 
aspects of an idea, Wherever a picture or a figure can enrich the text, we provide 
one. Furthermore, as the text progresses, we continuously order the statements 
of systems theory in their overall context. Accordingly, in this book a discussion 
of the importance of a mathematical formula or a theorem takes precedence over 
its proof. While we might omit the derivation of an equation, we never neglect 
a discussion of its applications and consequences! The numerous exercises at the 
end of each chapter (with detailed solutions in the appendix) help to reinforce the 
reader’s knowledge. 
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Although we have written this book primarily for students, we are convinced 
that it will also be useful for practitioners. An engineer who wants to brush 
up quickly on some subject will appreciate the easy readability of this text, its 
practice-oriented presentation, and its many examples. 

This book evolved out of a course on systems theory and the corresponding 
laboratory exercises at the Friedrich Alexander University in Erlangen-Niirnberg. 
The course is compulsory for students of electrical engineering in the fifth semester. 
As such, the material in this book can be worked through completely in about 50 
hours of lectures and 25 hours of exercises. We do assume knowledge of the fun- 
damentals of engineering mathematics (differential and integral calculus, linear 
algebra) and basic knowledge of electrical circuits. Assuming that this mathemat- 
ical knowledge has been acquired earlier, the material is also suitable for use in the 
third or fourth semester. An engineering curriculum often encompasses complex 
function theory and probability theory as well; although these fields are helpful, 
we do not assume familiarity with them. 

This book is also suitable for self-study. Assuming full-time, concentrated 
work. the material can be covered in four to six weeks. 

Our presentation begins with continuous signals and systems. Contrary to 
some other books that first introduce detailed forms of description for signals and 
only much later add systems, we treat signals and systems in parallel. The purpose 
of describing signals by means of their Laplace or Fourier transformations becomes 
evident only through the characteristics of linear, time-invariant systems. In our 
presentation we emphasise the clear concept of Eigen functions, whose form is not 
changed by systems. To take into account initial states, we use state space descrip- 
tions, which elegantly allow us to couple an external and an internal component, of 
the system response. After covering sampling, we introduce time-discrete signals 
and systems and so extend the concepts familiar from the continuous case. There- 
after discrete and continuous signals and systems are treated together. Finally, we 
discuss random signals, which are very important today. 

To avoid the arduous and seldom perfect step of correcting camera-ready copy, 
we handled the layout of the book ourselves at the university. All formulas and 
most of the figures were typeset in LaTeX and then transferred onto overhead slides 
that were used for two years in the systems theory lectures. We are most grateful 
to some 200 registered students whose attentive and astute criticism helped us to 
debug the presentation and the typeset equations. In addition, one year’s students 
read the first version of the manuscript and suggested diverse improvements. Fi- 
nally numerous readers of the German version reported typographic errors and 
sent comments by e-mail. 

Our student assistants Lutz and Alexander Lampe, Stephan Gédde, Marion 
Schabert, Stefan von der Mark and Hubert Rubenbauer demonstrated tremendous 
commitment in typesetting and correcting the book as well as the solutions to the 
exercises. We thank Ingrid Bartsch, who typed and corrected a large portion of 
the text, as well as Susi Koschny, who produced many figures. 
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For their attentive and tireless proof-reading, we especially thank Peter Eisert, 
Achim Hummel, Wolfgang Sorgel, Gerhard Runze and Reinhard Bernstein. For 
their generous availability for discussions about tricky mathematical questions, we 
sincerely thank Peter Steffen and Ulrich Forster. Edward Kimber has mastered 
the ambitious task of translating the German manuscript into English. Finally, we 
express our gratitude to John Wiley & Sons for their uncomplicated co-operation 
and their support of this project. 

When the second edition of this book appears, we would like to extend our 
list of acknowledgements. Therefore we have the following request, t0 our readers. 
Please send us your comments and suggestions. Uhe simplest route is per e-mail 
to stbuch@LNT.de. Whatever error you might detect and however small it may 
be, please do not keep it to yourself. We promise that we will take to heart. all 
serious comments. 


Erlangen, Germany, October 2000 


Bernd Girod Rudolf Rabenstein Alexander Stenger 
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1 Introduction 


Systems theory concerns signals and systems. What are signals? What are sys- 
tems? Before defining these terms, let us first examine some examples. 


1.1 Signals 


Signals describe quantities that change. Figure 1.1 depicts the electrical voltage 
that a microphone produces in response to the spoken word ‘car’. ‘This voltage 
corresponds largely to the acoustic pressure on our ear. which reacts to the changes 
in this pressure over time. The curve in Figure 1.1 shows the value of microphone 
voltage in relation to time. Since there is a vollage value for every point in time, 
we term this a continuous-teme signal. We call time the independent variable and 
the voltage changing over time the dependent variable or signal amplitude. We 
usually represent the independent variable horizontally (a-axis) and the dependent. 
variable vertically (y-axis). 


tal 


microphone voltage (mV) 
Q 


0 100 200 300 400 
time (ms) 


Figure 1.1: Example of a continuous-time signal: voice signal for the syllable ‘car’ 


Figure 1.2 depicts another continuous signal. The diagram shows the temper- 
ature curves for a house wall, not over time. but in relation to the location. The 
curves show the temperature profile inside a 15 cm thick brick wall where the air 
temperature at the right side suddenly rose by 10 Ik. One hour later the local 
temperature follows the curve represented by the thick line. At another time we 


1. Introduction 


i) 


would have a different temperature curve. In contrast to Figure 1.1, time here 
is a parameter of a family of curves; the independent continuous variable is the 
location in the wall. 


eo 


och 
Lo) 
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temperature difference [K] 


0 = sess 
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location [m] 
Figure 1.2: Temperature curve for a house wall 


Figure 1.3 shows another kind of variable quantity, the stock market index 
over time. Although this index changes all the while the stock market is open, the 
diagram shows only the weekly average. Thus the depicted value does not change 
continuously, but only once a week. When the signal amplitude occurs only at 
certain fixed points in time (discrete times), but not for points in between, we call 
the signal descrete or, more precisely, discrete-tame. In our example, however. the 
signal amplitude itself is not discrete but continuous. 


rr 


Jan 5, 19596 June 28, 1996 


Figure 1.3: The weekly German stock market index between January 5, 1996, and June 
28, 1996 


In Figure 1.4 we have entered the frequency of earned marks for a test in system 
theory at the University of Erlangen—Niirnberg in April, 1996. The individual 
marks assume only discrete values (1.0 — 5.0): the frequencies (in contrast to the 
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average stock index) are whole numbers and so likewise discrete. In this case both 
the independent and the dependent variables are discrete. 


~~ 
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frequency 
3 
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Trt 


1.0 1.3 1.7 2.0 23 2.7 3.0 33 3.7 4.0 43 47 5 
mark 


Figure 1.4: Frequency of earned marks for a test in systems theory 


The signals we have considered thus far have been quantities that depend on a 
single independent variable. However, there are quantities with dependencies on 
two or more variables. ‘The greyscales of Figure 1.5 depend on both the x and the 
y co-ordinates. Here both axes represent independent variables. The dependent 
variable s(a.y) is entered along one axis, but is a greyscale value between the 
extreme values black and white. 

When we add motion to pictures, we have a dependency on three independent 
variables (Figure 1.6): two co-ordinates and time. We call these two- or three- 
dimensional (or generally multidimensional) signals. When greyscale values change 
continuously over space or over space and time, these are continuous signals. 

All our examples have shown parameters (voltage, termperature, stock index, 
frequencies, greyscale) that change in relation to values of the independent vavi- 
ables. ‘Thereby they transmit certain information. In this book we define a signal 
as follows: 


Definition 1: Signal 


A signal is a function or sequence of values that represents mformaton. 
‘The preceding examples have shown that signals can assume different forms. Sig- 
nals can be classified according to various criteria, the most important of which 
are summarised in Table 1.1. 


1. Introduction 


y 


Figure 1.5: A picture as a continuous two-dimensional signal 


y 


Figure 1.6: Moving picture as an example of a continuous three-dimensional signal 


Table 1.1: Criteria for classifying signals 


- ad 
continuous(-time) -  discrete(-time) 
amplitude-continuous - amplitude-discrete 
analogue - digital 
real-valued - complex-valued 
unidimensional - multidimensional 
finite domain - infinite domain 
deterministic - stochastic 
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We have already discussed the difference between continuous and discrete sig- 
nals on the basis of Figures 1.1 and 1.3. Discrete signals are also termed discon- 
tinuous. Most of the preceding signals have been amplitude-continuous, becatse 
their dependent variable can take on any value. However, the signal in Figure 1.4 
is amplitude-discrete, for the dependent variable (number of examinees) can as- 
sume only integer values. Taken precisely, the stock index in Figure 1.3 is likewise 
amplitude-discrete, since the stock index is specified to only a certain number of 
decimal places. Signals whose dependent and independent variables are continu- 
ous are called analogue signals. If both variables are discrete, we call the signal 
digital. The output voltage of a microphone is an analogue signal, for at any given 
time amplitude values can be read with any desired precision. Sequences of values 
stored in a computer are always digital, since the amplitude values can be stored 
only with finite word length in distinct (discrete) storage cells. 


All of the signals we have considered so far had real amplitudes and so are 
classified as real-valued. Signals whose dependent variable assumes complex values 
are called complex-valued. 

The signals in Figures 1.1 to 1.4 are unidimensional, while those in Figures 1.5 
and 1.6 are multidimensional. For reasons of graphic representation. all the signals 
in the previous examples had finite domains of their independent variables and 
so are classified as finzte-domar signals. However, if we consider the signal in 
Figure 1.6 as the picture of a television camera, then the domain of the location 
variable becomes finite again due to the restricted picture excerpt, bul the domain 
of the time variable is infinite (neglecting the finite lifetime of the camera). 

Signals are termed delermensstic if their behaviour is known and can be rep- 
resented, e.g., by a formula. The deflection voltage of an oscilloscope is a deter- 
ministic signal, for its behaviour is known and can be represented as a sawtooth 
wave, By contrast. we cannot define the amplitude values of a voice signal (see Fig- 
ure 1.1) by means of formulae or graphical elements; furthermore, their continued 
behaviour is not known. Such signals are termed stochastic. Since it is impossi- 
ble to specify their behaviour in terms of functions. such signals are described by 
expected values (mean, variance and many others). 


1.2 Systems 


1.2.1 What is a System? 


We have seen that signals represent information. In many technical applications we 
want to do more than just view information: we want to store, transfer, or couple 
it with other information. This requires establishing and describing relationships 
between signals, This leads us to the definition of a system: 
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Definition 2: System 


A system ws the abstraction of a process or object that puts a number of signals 
unto some relatsonship. 


In this general form we can imagine a system as a black box that communicates 
with the outside world via various signals. Figure 1.7 depicts such a system that 
establishes a relationship among the signals 7; to tp. 


X4 XD Xp 


Figure 1.7- General system 


In many cases we can classify a system’s signals as input and output signals. 
Input signals exist independently of the system and are not affected by the sys- 
tem; instead, the system reacts to these signals. Output signals bear information 
generated by the system, often in response to input signals. The simple system 
in Figure 1.8 has one input signal x2 and one output signal y. We also term y the 
system. response to 2. 

Naturally a system might contain multiple inputs and outputs. The system 
determines the influence of individual inputs on the output signals. In general, 
each output depends on all inputs. To simplify the notation, we combine input 
and output signals in vectors (Figure 1.8). 


simple system multiple inputs, multiple outputs 


— system 
x y 


Figure 1.8: Input/output systems 
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1.2.2. The Domain of Systems Theory 


Systems theory does not encompass the implementation of a system from given 
components, but with the relationships that the system imposes between ils sig- 
nals. Systems theory represents a powerful mathematical tool for the study and 
design of systems, because omitting the implementation details helps to maintain 
an overview of the overall system. In systems theory the focus is on the formal 
nature of the interconnections rather than any specialisation for specific appli- 
cations. This allows systems theory a uniform representation of processes from 
different application domains (e.g., physics, engineering, economics. biology) and 
supports an interdisciplinary view. 

The high degree of abstraction brings the advantages of learning econonty and 
clarity. Learning economy ensues because the regularities of one field are easier 
because separating the detail problems from the general relationships is elevated 
to a principle. However, this is countered by the drawback of a certain amount of 
unclearness that encumbers initial learning in systems theory. 


1.2.3 Linear, Time-Invariant Systems 


An important subfield of systems theory is the theory of linear, time-invariant 
systems. This represents the classical core domain of systems theory and is well 
developed, elegant and clear. This theory also proves suitable for describing non- 
linear systems that can be linearised for small signal amplitudes. Systems theory 
for linear, time-invariant systems evolved from the practical problems of electrical 
engineering over more than a century [24]. Important application domains for the 
theory of linear, time-invariant systems in electrical engineering today include: 


® Analysis and design of electrical circuits 


e Digital signal processing 


® 


Communications 


Control engineering 
@ Measurement engineering 


This book covers only linear, time-invariant systems. First, however. we need to 
explain the terms linearity and time invariance. 
1.2.3.1 Linearity of a System 


To define the term linearity, let us consider the system in Figure 1.9. It responds 
to an input signal 2, (t) with the output signal y,(¢) and to the input signal x(t) 
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with the output signal y2(t). Can we deduce the output signal y(t) associated with 
the following input signal? 

a(t) = Ag,(t) + Bao(t) (1.1) 


In general we cannot make this step, but for many relationships between input 
aud output parameters, from (1.1) the output signal follows as 


y(t) = Ayr (t) + Bye(t) - (1.2) 
Examples include the relationship between current and voltage on a resistor as 


given by Ohm’s Law. between charge and voltage in a capacitor. and between 
force and stretching of a spring according to Hook’s Law. 


linear 
system 


linear 
system 


Figure 1.9: Definition of a linear system (A, B are arbitrary complex constants) 


Ax, (t)+Bxy(t) Ay, (+By(t) 


The relationship expressed in (1.1), (1.2) is called the superposition principle. 
ft can be defined more generally as follows: 


Definition 3: Superposition principle 


If the response of a system to a@ linear combination of input signals always 
consists of the corresponding combination of the individual output signals, then 
for this system the superposition principle. applies. 


Due to the great importance of such systems, we also use a more tangible term: 


Definition 4: Linear systems 


Systems for which the superposition pronciple applies are called linear systems. 


1.2. Systems 9 


For the system in Figure 1.9 the superposition principle is 


a(t) = Aay(t) + Bro(t) y(t) = Ay (t) + Byo(t) (1.3) 


Here A and B can be any complex constants. The superposition principle can 
be extended directly to linear combinations of more than two signals [19] and 
formulated for systems with multiple inputs and outputs [23]. One important 
special case derives directly from (1.3) with A = B = 0: 


a(t)=0 — y(t)=0, VteER. (1.4) 


If we apply to the input of a linear system a signal «(t) that is always null. then 
the output signal must also always be null; otherwise it is not a linear system. 
However, equation (1.4) must not be misinterpreted as indicating that at every 
point in time at which the input signal passes through zero, the output signal must 
also pass through zero. 

To be precise, the superposition principle applies for real systems only for a 
restricted range of the constants A and B. For the voltage drop at a real resistor, 
Ohm's Law applies only within limits where the resistor is not destroyed by the 
heat produced in it. Even within these limits, we observe small deviations from 
Ohm ’s Law caused by the temperature dependency of the material parameter. On 
the other hand, resistors are normally operated only within the currency and volt- 
age ranges in which deviations from Ohm’s Law are negligible. The same applies 
analogously for all other applications of the superposition principle. Assuming the 
linearity of a system is thus always an idealisation that applies at acceptable pre- 
cision only within certain limits. However, since this assumption very significantly 
simplifies the analysis of systems, it is employed as much as possible. 


1.2.3.2 Time Invariance of a System 


The second important system characteristic that we generally assume in this book 
is time invariance. If we know, as in Figure 1.10, the response y(t) of a system 
to the input signal a(t). can we then conclude the response to the input signal 
a(t — t), delayed by time z? Certainly this is possible if the characteristics of 
the system S do not change over time. The response of the system would be 
the same, so that we can count on a correspondingly delayed output signal for a 
delayed input signal. This consideration leads us directly to the definition of a 
time-invariant system: 


Definition 5: Time-invariant system | 


A system that responds to a delayed input signal with a correspondingly delayed 
output signal is called @ time-invariant system. 


This definition can be generalised for systems with multiple inputs and outputs 
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[19]. In the definition we could exchange a delayed and a nondelayed signal and 
recognise that the delay in Figure 1.10 could assume positive or negative values. 


a(t) +» y(t) 
a(t—ct) — y(t— 7) 


Figure 1.10: Definition of a time-invariant system 


1.2.3.3 LTI-Systems 


Linear systems are not generally time-invariant. Likewise, time-invariant systems 
need not be linear. However, as already mentioned, systems that are both linear 
and time-invariant play a particularly important role in systems theory. They have 
been assigned the acronym LTT. 


Definition 6: LTI-system 


A system that 1s both tume-invariant and linear 1s termed an LT 1-system 
(Linear Time-Invariant system). 


The characteristics of LTI-systems and the tools for their analysis are the subjects 
of subsequent chapters. 


1.2.4 Examples of Systems 
1.2.4.1 Electrical Circuits 


As an example of the description of an electrical circuit as a system, we employ 
the branching circuit in Figure 1.11. The time-dependent voltages u;(#) and we(t) 
represent continuous signals, such as the voice signal in Figure 1.1. The circuit 
establishes a relationship between two signals and is thus a system. To abstract 
away from the electrical nature of the inner workings and the enclosed components 
with their regularities, we move to the representation as an input/output system 
in Figure 1.8. As long as we have no further information on the origin of these 
signals, the assignment of input signals to output signals is random. The laws of 
circuit theory for the idealised components (ideal resistors and capacitors) allow 
us to represent this circuit as a linear and time-invariant system (LT J-system). 
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(inverse) 
sysiem Hol ft) 


Figure 1.11: Electrical circuit as a system 


1.2.4.2 Further Examples of Systems 


Figure 1.12 shows additional examples of well-known relationships drawn using 
system theory. 


position of 
gas pedal 
i speed 
position of 

brake pedal 


acoustic pressure 
of the mouth -———-» 
of the speaker 


acoustic pressure 
> at the ear of the 
listener 


telephone 
network 


gross national product 
inflation rate 
unemployment rate 


national 


interest economy 


Figure 1.12: Examples of systems 


The speed of a car depends on the positions of the gas and brake pedals. This 
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relationship can be represented by a system with two inputs (the positions of 
the respective pedals) and one output (the speed). The system is certainly not 
linear. For example, the relationship between responses to the positions of the 
gas pedal and brake pedal is not simple, as would be the case in a linear system: 
instead, the braking effect depends on the speed and thus on the preceding position 
of the gas pedal. Also, the system is not time-invariant, since the gas pedal 
(input parameter) affects the speed (output parameter) differently depending on 
the position of the gear shift lever and the inclination of the street. Under ideal 
conditions, for example, with an automatic transmission on a flat. straight test 
route, the system would approach time invariance. Over the same time. given 
angles of the gas pedal and brake pedal would result in the same speed at a later 
time. In practice, time invariance is a frequent goal in technical systems in order 
to make the system response predictable. 


The second system describes a telephone network with the acoustic pressure 
from the mouth of a person (speaker) as input signal and the acoustic pressure at 
the ear of another person (listener) as output signal. At first glance. in the range of 
acoustic amplitudes that occur while telephoning, the system can be viewed as lin- 
ear and time-invariant. However, if we do not wish to neglect distortion and other 
disturbances, then this idealisation as a linear system no longer applies. Likewise, 
the system is time-variant (i.e., not time-invariant), because a later connection 
might yield different transmission quality. 


The third example shows the application of systems theory to a nontechnical 
domain. The interest rate established by the national bank influences the economy, 
which can be assessed via various parameters such as the gross national product, 
the inflation rate, and the unemployment rate. In contrast to the automobile and 
telephone examples above, here our system analysis cannot establish relationships 
between input and output parameters based on recognised laws of nature. Instead. 
we have economic models that more or less describe economic phenomena. Here 
a system description is based on the assumed validity of the underlying model. 


In all cases the system description is based on simplified assumptions, for it 
is never possible to incorporate all parameters into a model. Thus the speed of 
a car also depends on a number of other parameters, such as the road condition, 
the wind direction and velocity, the fuel quality, and the vehicle’s condition. For a 
single vchicle and with painstaking effort, it might be possible to accommodate all 
parameters correctly. On the other hand. to describe the functioning of a world- 
wide telephone network, we would never succeed if we began with the Maxwell 
equation for each electrical component. As a major strength, systems theory per- 
mits describing input/output relationships on different levels of abstraction. It 
makes sense to begin a system analysis with few parameters and simple mod- 
els. As necessary, individual systems can be modelled more precisely with more 
detailed subsystems. 
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Table 1.2: Criteria for classifying systems 


continuous - discrete | 
analogue - digital 
real-valued - complex-valued 
unidimensional - multidimensional 
deterministic - stochastic 
causal - noncausal 
with memory - memoryless 
linear - nonlinear 
time-invariant - time-variant 
translation-invariant -  translation-variant 


1.2.5 Classification of Systems 


As with signals, we can classify systems according to various criteria. ‘The most 
important criteria are summarised in ‘Table 1.2. 

A number of these criteria are familiar from signals. Thus continuous or dis- 
crete. analogue or digital, real-valued or complex-valued, unidimensional or multi- 
dimensional systems are systems that establish relationships between signals with 
these characteristics. A digital system is thus one that processes digital signals. A 
system is causal if its response to the arrival of a time signal does not begin before 
this arrival. This sounds trivial, for all systems described by the laws of nature 
are necessarily causal. However, some important idealisations result in noncausal 
systems. In some cases it is easier to work with idealised, noncausal systems than 
with real, causal ones. Furthermore, there are systems whose independent. variable 
is not time. For memoryless systems, the response to a time signal at a certain 
time depends only on the value of the input signal at the same time. By contrast, 
for memory systems the values of input signals of other times also play a role; 
naturally, for causal memory systems these other values must be those of previ- 
ous times. Linear and time-invariant systems were discussed in Sections 1.2.3.1 
and 1.2.3.2. For systems whose input parameters depend not on time but on other 
independent variables, we can define a characteristic corresponding to time invari- 
ance. Thus the temporal delay in a locatiou-independent signal (e.g., a picture) is 
a translation. In more general terms, this is a translation-invariant system. 


1.3. Overview of the Book 


Chapter 2 shows several possibilities for describing comtinnous-time LTLsystems 
over time. We base the material on known methods for solving linear differential 
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equations with constant coefficients. 

Studying LTI-systems over a frequency range (Chapter 3) leads us to the repre- 
sentation of continuous-time signals with the help of the Laplace transform, which 
we discuss in detail in Chapter 4. Chapter 5 presents the inverse formula of the 
Laplace transform and its fundamentals in complex function theory. The analysis 
of LTI-systems with the Laplace transform and its characterisation via the sys- 
tem function is the subject of Chapter 6. Although linear differential equations 
with constant coefficients and specified start values are no longer LT]-systems, LTI 
methods can be elegantly extended for this important class of problems (Chap- 
ter 7); this occurs primarily via system description in state space. 

Another kind of characterisation of LTI-systems in time by convolution with 
the impulse response is discussed in Chapter 8. In order to be able to describe 
the impulse response mathematically, we introduce generalised functions in this 
context. 

An integral transformation equal in importance to the Laplace transform is 
the Fourier transform, whose characteristics and laws are discussed in Chapter 9. 
The graphical analysis of the frequency response of systems by means of Bode 
diagrams is the subject of Chapter 10. 

Chapter 11 concerns sampled and periodic signals as well as the sampling theo- 
rem and leads us to discrete-time signals and their Fourier spectrum (Chapter 12). 
In Chapter 13 we handle discrete signals with the z-transform, the discrete coun- 
terpart of the Laplace transformation, and in Chapter 14 we use it to analyse 
discrete-time LTI-systems. 

In the subsequent chapters continuous and discrete systems and signals are 
treated in combination. The characteristics of causal systems and signals and 
their description with the Hilbert transformation is the subject of Chapter 15, 
and Chapter 16 presents stability characteristics of systems. 

In Chapter 17 we introduce random signals and their description via expected 
values; in addition, we discuss a frequency response representation of random 
signals via power density spectra. Finally, Chapter 18 is dedicated to the question 
of how expected values and power density spectra are modified by LTI-systems. 


1.4 Exercises 


Exercise 1.1 


Are the following signals amplitude-discrete, discrete-time and/or digital? 
a) number of days of rain per month 
b) average high temperature per month 


c) current temperature 
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d) momentary population of China 
e) daily milk production of a cow 
{) brightness of a pixel on a television screen 


Exercise 1.2 


Are the signals stored on a computer hard disk analogue or digital signals? Answer 
the question from different viewpoints. 


Exercise 1.3 


An ideal A/D converter could be constructed as follows: 


system 2 
quantizer 


system 1 


sample & hold 
x 


a) Which of the signals x1... are analogue, amplitude-discrete, discrete-time, 
digital? 


b) For both systems. specify whether they are linear, time-invariant, analogue, 
with memory, causal. 


Exercise 1.4 


Which of the following system descriptions designate linear, time-invariant, mem- 
ory, or causal systems? 


a) y(t) = a(t) 
b) y(t) = 2(t) 
c) y(t) =a(t-T). TL >0 (delay component) 


d) y(t) =a(¢+T), T>O0 (accelerator) 


f) y(t)=# f x(e)dt’ T>O0 (moving average) 
iF 


di 
g) - +ay(t) = x(t) (electrical circuit) 


bh) y(t) =a(¢-—T(t)), T(t) >0 (phase modulation) 
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i) y(t) = x(t~ T(t)), T(t), arbitrary 
Exercise 1.5 


Two systems S; and Sy respond to an input signal x(t) with the output signals 


y(t) = Sy{2)} = m-x(t)-cos(wrt) 
yo(t) = Sof{x(t)}} = [l+m-a(t)]-coswrt) meR., 


Are the systems a) linear. b) time-invariant, c) real-valued, d) memoryless? 


Exercise 1.6 


A black-box system is to be examined to determine whether it is time-invariant 
and linear. Three measurements of the system yielded the following data: 


1. Input of 2 ,(€) produces the output signal y(t). 
2. Input of 22(t) produces the output signal yo(t). 


3. Input of x3(t) = 11 (t — 7’) + xo(t — T) produces the output signal y3(t) # 


Can you make an unambiguous statement about the above system characteristics? 
Defend your answer. 


2 Time-Domain Models of 
Continuous LTI-Systems 


In the last chapter we introduced the concept of systems and some of their general 
properties. In this and some of the following chaptcrs we will get to know some 
of the different methods that can be used to model these systems. We will begin 
by looking at continuous-time systems and restrict ourselves to LTT (linear time- 
invariant )-systems. 

In Chapter | we established a requirement for a system model in which we 
are not concerned about the details of the individual components. Instead, we 
are looking for a standardised form of system model that represents the input 
output characteristics of a system by mathematical equations, independent from 
the implementation of the system. 

This chapter deals with the following three modelling techniques for continuous- 
time systems: 


e differential equations as a mathematical representation of the input-output 
relationship, 


e block diagrarns as a graphical representation of the relationship between 
input, output and internal states, 


® state models that are the equivalent of the block diagrams. 


Common. to all three of these modelling techniques is the use of time-dependent 
signals, in which the derivative and the integral with respect to time plays an 
important role. Therefore these types of system model can be classified as ‘time- 
domain models’. Their complements are ‘frequency-domain models’. which will be 
examined in the next chapter. 


2.1 Differential Equations 
2.1.1 System Analysis 


Our goal is to find a system model without details of the system implementation. 
Tow can this be achieved? We will use the analysis of an electrical circuit to show 
the essential steps. 
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In many cases it is possible to ignore the spatial expansion of electrical com- 
ponents on a circuit board. and instead work with equivalent circuits consisting 
of concentrated elements. Semiconductor devices are an example of this because 
their complicated internal behaviour can only be accurately modelled using solid- 
state physics. Their effects within an electrical circuit are, however, often linear 
enough to be adequately modelled by simple components like resistances and ideal 
sources. 

The second step is the replacement of the physical components with their 
ideal equivalents, for example, real resistances become ohmic, wires become ideal 
conductors. capacitors have ideal capacitance. etc. 

The resulting electrical networks (for example, Figure 1.11) can be analysed 
using standard methods, for example, mesh or nodal analysis [18, 22]. This results 
in ordinary differential equations with constant coefficients, in which only the input 
and output signals and their derivatives occur. 

This process can also be applied to other physical arrangements which, like 
electrical circuits, can be described by potential (e.g. electrical voltage) and flow 
quantities (e.g. electrical current). The analysis accordingly simplifies mechanical, 
pneumatic, hydraulic and thermal systerns to differential equations. The same 
applies to other kinds of system, for example, from chemistry, biology or economics. 

The simplifications mentioned are of course not always permissible. Ordinary 
differential equations arc, for example, unsuitable for the field of fuid dynamics 
problems. In many other uses, however, they are of great importance, and we will 
therefore examine them in more depth. 


2.1.2 Linear Differential Equations with Constant 
Coefficients 


Differential equations establish relationships between derivatives of dependent 
quantities with respect to independent variables. They are called ordinary dif- 
ferential equations if the derivatives only occur with respect to one of the indepen- 
dent variables (e.g. time). Differential equations with derivatives with respect to 
more than one independent variable (e.g. time and three spatial coordinates) are 
called partzal differential equations. A differential equation is said to be linear if 
the individual derivatives are only multiplied by factors and combined by addition. 
Additionally. if the factors of the derivatives do not depend on the independent 
variables, the term ‘differential equation with constant coefficients’ is used. 

For modelling of continuous-time systems, we just need ordinary differential 
equations with time as the only independent variable. In such equations the input 
and output signals of the system must occur as dependent variables. We will 
soon discover that linear, and time-invariant systems can be modelled by linear 
differential equations with constant coefficients, so we will restrict ourselves to this 
type of equation. 

Simple examples for linear differential equations with coefficients are 
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+ wax (2.1) 
i+ By + Qy = Wz --e. (2.2) 


The general form of an ordinary linear differential equation with constant coeff- 
cients 1s ; 
M : 
dy dkx ; 
oy = Bn - 2.3 
oy "dt 3 dik 2) 


am k=0 


The greatest index N of a non-zero coefficient ay determines what is called 
the erder of the differential equation. In order to simplify this discussion, we let 
M = N and allow some, but not all of the coefficients 4), to be equal to zero. 

For a given function x(t) there are up to N different linearly ndependent so- 
lutions y(t) to (2.3). For a particular solution, we need to give N conditions. For 
initial condition problems, these would be N initial conditions y(0). g(0). 7(0),.... 

The differential equation (2.3) describes a continuous-time system, if a(t) is the 
input signal, and y(t) is the output signal. In order to characterise this system, 
we refer back to Definitions 4 and 5 and also Figs. 1.9 and 1.10. For now, we 
ignore possibly given initial conditions; their influence will be discussed in depth 
in Chapter 7. 

Let us now show that (2.3) represents a time-invariant system. Through sub- 
stitution of variables t/ = t~ z in (2.3), it follows immediately that 2(t—~ c) leads to 
the solution y(t — z). To show linearity we consider the two different input signals 
x(t) and a(t) and the corresponding solutions y;(t) and y2(t). Plugging the linear 
equation x3(t) = Az,(t) + Bx2(t) into (2.3) verifies that y3(t) = Ayi(t) + Bya(t) 
is a solution of the differential equation, and therefore the output signal of the 
system. 

Every system that can be modelled using linear differential equations with 
constant coefficients (2.3) is thus an LTI system. This means we have found our 
first method for modelling such systems in the form of a differential equation. This 
method fulfills our initial requirements: 


e® Modelling of an LTI-system independent from its realisation. 


e Representation of the input-output relationship, without details of the sys- 
tem’s internal behaviour. 


2.2. Block Diagrams 


Block diagrams can represent more information than differential equations as they 
show not only the input and output signals but also internal states of a system. If 
only the input-output relationship is of interest then the choice of internal states 
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is not relevant. and there are many block diagrams that correspond to the same 
differential equation. In case additional specitications of the internal structure 
are available, the block diagram can be constructed in a way that represents the 
internal states of the system. for example, the energy stored in the components of 
an electrical network. 

From the many possible structures of block diagrams, there are some which 
are particularly suitable if the differential equation of a system is already known. 
We will examine three such structures in more detail. 


2.2.1 Direct Form I 


Our starting point is an LT'T-system that is modelled by differential equation (2.3), 
with Af = N. We integrate both sides N times. 


N N ; 
a, { ydt = by, edt (2.4) 
d J (3) = Le 


k=O 


with a, = ay_, and by = Gy_,. We write hey ydt for the 2-times integra! 


at an »To 
i ydt = | | ae | y(t )dt|...d%_1| dz, . (2.5) 
J (4) Jo | J —oo JOD 


The rearrangement 
g 


N N : 

1 ; ng, ro 

y~ | yat = — be | x dt — a, | y dt (2.6) 
(0) ao S (k) » (a) 


k=0 : 


leads immediately to the block diagram of an LTI-system in ‘Direct form P (Fig- 
ure 2.1). The rectangular boxes represent multiplication by the factor shown 
within, or alternatively a single integration, and the circle with a summation sign 
stands for addition of the input signals. 

The advantage of block diagrams with this structure is that the coellicients 
of the differential equation appear directly as the values of the multipliers. The 
disadvantage is that for a N-order differential equation, 2N integrations must be 
performed. 


2.2.2 Direct Form IT 


We will now construct a new form of block diagram with a different structure that 
only uses N integrators. To create the new structure, we manipulate direct form 
I, interchanging the first and second stages (Figure 2.2). This is permissible. as 
cascaded LTI-systems can be interchanged without affecting their overall transfer 
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Figure 2.1: LTI-System in direct form | 


function. We will show this general concept more elegantly in Chapter 6.6.1 with 
the help of a frequency-domain model. At the moment. however. we will just view 
this property as a useful assumption. Both cascades of integrators in Figure 2.2 
run in parallel since the input signals of the integrators from time t = —9o are 
equal, and so are their output signals. We can therefore unite the two cascades. 
arriving at direct form II shown in Figure 2.3. 

As with direct form I, the multiplier coefficients of direct form II are the co- 
efficients of the differential equation. More importantly, this form requires the 
only N integrators, the minimum number for an N-order differential equation. 
Block diagrams that use the minimum number of energy stores (integrators) for 
the realisation of an N-order differential equation are also called canonical forms. 

The signals ~. 2= 1,....,N at the integrator outputs describe the internal 
state of a system. that is not only modelled by the corresponding differential 
equation (2.3), but is further given an internal structure by direct form Il. Without 
knowledge of the actual realisation of the system, this assignment of states is. of 
course, entirely arbitrary. 

We constructed direct form I directly from the differential equation, and it is 
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y(t) 


Figure 2.2: Derivation of the block diagram for direct form [I from direct. form I 


clear that systems with this structure satisfy the differential equation (2.3). We 
still need to ensure that direct form IT satisfies the same differential equation. 
After all, we made use of the as yet unproven assumption that the two stages of 
direct form I can be interchanged to create direct form II. To verify direct form IT 
we first express the input signal 2 and the output signal y in terms of the states 
Bie Cee Meee cINe, 


Uhe input and output signals are linked through the states at the integrator 
outputs, but also directly through the uppermost path, and of course we have to 
consider this path as well. To simplify the notation we introduce another internal 
signal 29, and emphasise that it does not represent a state. 


From the block diagram (Figure 2.3) the relationships 


N N 


y= 3 b; z, and 2g pa LR s° Oy 2, (2.7) 


a=xQ) 
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x(t) . y(t) 


Figure 2.3: An LTT-system in direct form II 


are obtained directly. The last relationship can be rewritten as 


re 
= ye On, Zp « (2.8) 


a==0 


Additionally. every state variable z, can be obtained by integrating zo 7 times. 


a= | ag dl. (2.9) 
Jay 


We now insert (2.7) into the left-hand side of the integral equation (2.4) which 
is equivalent to the differential equation (2.3). By interchanging the order of the 
summation and integration, and further using (2.9), we obtain 


t=] S bh, 2, dt = 
N 
= Soa f ntt= Youn | zy dt . (2.10) 
ke=0 1=0 k=0 10 (k+7) 


Integrating zy repeatedly k +7 times is equivalent to integrating z, repeatedly 
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i times. Interchanging the order of integration and summation yields 


N 


asf ydt = : Yawn | eesti See (2.11) 


b= y 010 7 (a) 1=0 (i) poo 


The last sum we recognise as x as in (2.8), hence the integral equation (2.4) is 
satisfied. This shows that the input and output signals of a system in direct form 
II indeed satisfy the differential equation (2.3). as we had hoped. 


Example 2.1 
We will construct a block diagram for the equation 


dij + 2y = 3b +2. (2.12) 


We can create the direct form IL block diagram shown in Figure 2.4 directly from 
Figure 2.3. 


x(t) y(t) 


Figure 2.4: Example of a direct form IL block diagram [Example 2.1] 


2.2.3 Direct Form III 


The construction of another commonly used structure again originates with the 
differential equation (2.3). In contrast to direct forms I and II we will make no use 
of integral equations or rearrangement of block diagrams. Instead we obtain the 
state variables directly from the differential equation. The transformation takes 
N steps, each made up of the following elements: 


® rearrangement of the differential equation 
e introduction of a new state variable 


® integration 


bo 
an 
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este erent 


In the first step the differential equation is rearranged so that all the derivatives 
are on the left-hand side. The remaining right-hand side becomes the derivative 
of the new state variable zy: 


N , N ks 
d’y —~ , dx, . ae 
> Oy ae = Brae = Got — Qoy = En - (2.13) 
dt’ dt 
vl kes 
After integration we obtain 
CS ., ee ae dk 
41.3 y Opap—me = ON. (2.14) 
Dd, HG are ee 
ges jo 


The second step starts again by collecting all the derivatives on the left-hand side 
and introducing a new state variable for the right-hand side. 
N-1 


d'y 4, 2 . 
04415 — ) Bereta = tn + fhe- oy = 2n-1. (2.15) 
2, Mtg th Ge : 
al k=] 
Integration and changing indices yields 
N 2 N~2 . 
3 d'y 3 d‘x (2.16) 
427 s Derg—ap = SNK-1- . 
+2 at! Soma ee : 
w=) k=O 


dy dx: 
an Bn = fy + Sy_in@-an_iy = X4 . 2.17 
Ny ON 9 + ON AI An —14 rl ( ) 
The final integration yields 
ONY — Gna = 21. (2.18) 


Before drawing the block diagram we summarise the important equations and 
rename the coefficients such that a, = an_,,. by = OnN—p 


; = cs 
Yy = ie, + boa] 
ag 
By a 29 + be - ay 
29 = 23 + box ae Gay (2 19) 
on-r = =n + by-it - an-1y 
IN = bnxr  -— any 


The block diagram representation is shown in Figure 2.5. It can also be ob- 
tained graphically from direct form 0 (Figure 2.3), if 


® input « and output y are exchanged. 
e all arrows are reversed and 


@ summation and splitting nodes are exchanged. 
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x(t) y(t) 


Figure 2.5: LTI-system in direct form IT] 


Example 2.2 
The structure of an LTI-system in direct form IT] can be obtained for differential 

equation (2.12) from Example 2.1 through the steps described above. As it is a 

differential equation of the second order. two steps have to be performed transform. 
The first step introduces the state variable za: 


4yj—-yt3e = xr-2=% (2.20) 
4y—y+3u = xz (2.21) 


The second step introduces the state variable 21: 


4y = wz —-3r+y= 4; (2.22) 
4y = 2% . (2.23) 


The block diagram in direct form HI can be formed from the equations 


y= 


4 = 2% j—- 8 +: ¥y (2.24) 
b = x - 2y 
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x(t) 


cle | a 


Figure 2.6: A direct form Hd block diagram from Example 2.2 


and is shown in Figure 2.6. 


2.2.4 Why not use Differentiators to Build LTI-Systems? 


Block diagrams and differential equations are equally valuable forms for modelling 
LTLsystems. With block diagrams of the direct form IJ, II and III the eorrespon- 
dence of the block diagram and differential equation is sufficiently strong that the 
coefficients of both forms agree. The most striking difference is that differential 
equations are made up of derivatives, whereas block diagrams contain integrators. 
Why not remove this difference and construct block diagrams using differentiators? 

If block diagrams only existed as models of already iraplemented systems. then 
using differentiators would make no difference. Block diagrams also have another 
useful task, however: they serve as a model for the realisation of systems which 
do not yet exist. The required transfer function can be mathematically formu- 
lated as a differential equation and converted into a block diagram, from which 
the individual components can then be created. In order to decide whether differ- 
entiators or integrators are more suitable as a starting point for implementation. 
the characteristics of the signals involved must be considered. 


Every analogue signal is subject to corruption by noise, ie., it contains un- 
wanted and generally rapidly changing components. Differentiators anyplify rapid 
signal changes and thus increase the level of unwanted noise. Integrators. how- 
ever, smooth and suppress the undesirable noise. It is for this reason that block 
diagrams formed with integrators lead to superior, more robust realisations. An 
example for the physical realisation of an integrator follows im the next section. 
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2.2.5 Electrical Implementation of an Integrator Using an 
Operational Amplifier 


Operational amplifier (op-amp) circuits are an important example of the electical 
implementation of integrators. Op-amps are semiconductor amplifiers that usually 
come in the form of integrated circuits and can be well approximated using a very 
simple model. 


Uo 


Figure 2.7- Symbolic representation of an op-amp 
An ideal op-amp (Figure 2.7) has the following characteristics: 


e The input impedance is infinite, ie., no current Hows between the (+) and 
(-) terminals. 


e ‘The output impedance is zero, hence the output is an ideal voltage source. 


e The amplification factor A is infinite (> 10° for a real world op-amp). 


the same potential. 


With these characteristics it is easy to show that an op-amp with capacitor feed- 
back integrates the input voltage u,(t). 


i(t) uc{t) 


u(t) | | ust) 


Figure 2.8: Op-amp with feedback circuit 


Because of the infinite input impedance the current 2(¢) through the resistor 
is equal to the current through the capacitor C’. The infinite amplification forces 
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the two terminals to the same potential. hence the voltage across the resistor is 
equal to the input voltage u,(t). The current i(t) is therefore: 


u(t) = a) ~ oe , (2.25) 


From that follows the required integral relationship between uw (¢) and w(t): 


u(t) = aii : uy (t) dt. (2.26) 


The circuit given is therefore an integrator of the input voltage. As addition and 
multiplication are likewise possible using op-amps with other circuit configurations, 
systems can be implemented as electrical circuits directly from block diagrams. 


2.3 State-Space Description of LTI-Systems 


Tn Section 2.2 we had already used the concept of the statc of a system loosely. 
Now we will give a formal definition. 


Definition 7: System state 


The system state 1s @ vector of internal variables with tts future values depen- 
dent on its current values, which fully captures the effect of the past on the 
future behaviour of the system. 


We saw with the introduction of block diagrams that the use of internal states 
leads to a, more intuitive system representation than a differential equation alone. 
The choice of the variables is. however, arbitrary because the differential equation 
describes the input-output function and does not contain any information about 
the internal behaviour of the system. 

The state-space description offers the possibility of representing the internal 
form of a system in a standardised form of differential equations. In contrast to 
the differential equation (2.3), that is a single equation of order NV, the correspond- 
ing state-space representation is a system of N first-order differential equations. 
Each differential equation is valid for one of the N so-called state variables (state 
equation). The output signal is obtained by a linear combination of the states 
(output equation). 


2.3.1 Example of the State Model 


The following example shows how the state model is used to represent an electrical 
circuit. The RLC circuit in Figure 2.9 can be examined using the standard methods 
of circuit analysis. 
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Figure 2.9: RLC circuit 


The sum of the voltages in both meshes and the sum of the currents in the 
node yield 


di. — 
re = —~R,i,(t)— u(t) +2(t) (9:97) 
dio : 
ere = — Raig(t) — u(t) (2.28) 
du 
c= = a(t) +io(t) (2.29) 
The output voltage y(t) is the voltage drop across the resistor Ra: 


From these three first-order differential equations we could eliminate 4. 7g and u41 
and obtain a third-order differential equation in the form of (2.3). However, this 
would result in the loss of information about the internal energy stores that deter- 
mine the system behaviour. Instead, we represent the equations (2.27) to (2.30) 
in matrix form: 


Ws «. 2h 
q | a(t) ee ee a(t) 7m 
ay = 0 as a io(t) | +] “qi | a(t) (2.31) 
uy (t) 1 i ie w(t) 0 
a mae ( 
Cc C ‘ 
iy (t) 
y(t) = [0 —Rz 0] | ie(t) ; (2.32) 
ur(t) 


(2.31) and (2.32) are a system of three connected first-order differential equations 
and au algebraic equation. The three differential equations can also be viewed as 
a matrix differential equation for the vector 


a4 (t) 
a(t) = | in(t) 
uy (t) 
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It contains the voltage u, across the capacitor and the currents 2; and ig through 
both inductors. They characterise the system’s three energy stores and are state- 
variables. 


2.3.2 General Form of the State Model 


We can easily generalise the previous example to arrive at the general form of the 
state-space description. With the abbreviations A.B,C.D for the vectors and 
matrices in (2.31) and (2.32) we obtain the following standardised form of the 
first-order matrix differential equation and of the algebraic equation. It is given 
here for the general case with AV inputs and A’ outputs 


z= Az + Bx (2.33) 
y = Cz + Dx. (2.34) 
Where: x: column vector AZ input signals 
ze column vector N state variables 
y: column vector K output signals. 


The matrix differential equation (2.33) is called the state equateon and the 
algebraic equation (2.34) is called the output equation. The N x N matrix A is 
called the system matrix. It describes how the change of the state vector z depends 
on the instantaneous value z, The matrices B (size N x M) and C (size K x N) 
characterise the influence of the input. x on the state z, and the effect of this state 
on the output y respectively, The matrix D (value K x MM) describes the direct 
influence of the input on the output. 

In the example in Section 2.3.1 with only one input and one output (Af = K = 
1). B is a column vector and C is a row vector, and there is no direct influence of 
the input on the output (D = 0). 

Although in this example we started with a specific realisation of a system in 
the form of the electrical network in Figure 2.9, the state model does provide a 
universal representation of a system behaviour. The internal working of the system 
as given by the details of the network is captured by the states of the three energy 
stores. Together, these system states contain all relevant information about the 
past of the system. Starting with an initial state a(ty) at time to, we can uniquely 
determine the state of z(t) at any future time #, if the input signal x(t) is know 
between ty and ft. 

The state-space description is especially advantageous for systems with many 
inputs and outputs, for which working with scalar equations with many variables 
would be very cumbersome. 
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Of course. there exists a close relationship betweeu the state-space representa- 
tion, the block diagram and the differential equation of an Nth-order LTT-system. 
We will examine an example of this in the next section. 


2.4 Higher-order Differential Equations, 
Block Diagrams and the State Model 


In order to establish the relationship between the models for LT I-systems previ- 
ously examined, we consider the direct form [I block diagram in Figure 2.3 and 
look for the corresponding state model. We represent the integrators in Figure 2.3 
by the differential equations 


ine | thse: N. (2.35) 
We have already expressed the input signal of the first integrator through the state 


variables and the input signal in (2.7). Substituting (2.35) in (2.7) and collecting 
the scalar variables gives the state equation 


t ay ag an an 4 
ay Ses Seer? Tee fae = ay | 
, clyy ag ag a . 
2g 1 oy 0 0 29 0 
23 a 0 l She Q 0 on = ae ter ca 
ag 
: : 6) 
EN 0 On ah 1 0 ZN 0 


(2.36) 
The output equation can be immediately taken from direct form [1 (Figure 2.3). 
Note that from every state there are two paths to the output: one through coeffi- 


cients 6;, and one through a, 


and bo. Therefore the otitput equation becomes 
ao 


' b l b 
y= E _ ai ve by - “a : a =e . (2.37) 


gy ae 


The equations (2.36) and (2.37) represent the complete state model of the system 
given as a direct form IT block diagramn. 

As the direct form I realises the input-output behaviour of the integral equa- 
tion (2.4), or alternatively, differential equation (2.3), a connection is also estab- 
lished between the Nth-order differential equation (2.3) and the matrix differential 
equation (2.33). We can make this even more explicit by writing the state model 
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with coefficients a, = ay... and 3; = by, of the differential equation (2.3). Cor- 
respondingly, we re-index the state variables as ¢, = zn—.41.- 
Then the state model is 


€ = AC+Bz (2.38) 
y = C¢+Dz (2.39) 
with the matrices 
0 | 0 i) 
A = 0 Q) ang 1 0) (2.40) 
0 0 0) 1 
— oO Oy QN-2 — AN-i 
ON uN ON ON 


| ‘ 

B= —-|]' (2.41) 
CON 0 

1 

T 3 5 On 

C = 1h -— Xa, Oho Ns (2.42) 
i ON CON 
3 

p= =, (2.43) 
OON 


‘The elements of the state matrices A. B, C. D, can be calculated directly from 
the coefficients of the differential equation (2.3). The special form of the system 
matrix (2.40) for direct form II is called the Frobenius matraz. 


2.5 Equivalent State-Space Representations 


The state matrices (2.40) to (2.43) deseribe only one of many possible structures 
of block diagram, here direct form IL. Alternative structures that yield the same 
input-output behaviour can be obtained by transforming other state variables. 
This transformation can be formally expressed by the multiplication of a state hy 
a transformation matrix T 

z= Tz. (2.44) 


In this equation @ is the new stale vector. The transformation matrix T of size 
N x N must not be singular, so that inversion is possible, but otherwise there are 
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no restrictions. Substitution into (2.33) and (2.34) and multiplying both values 
by T7! gives the new state-space equations 


es Aa + Be | (2.45) 

y = C4 + De | (2.46) 
with the matrices 

A = TAT (2.47) 

B= TB (2.48) 

C = CT (2.49) 

D= D. (2.50) 


These are equivalent to (2.33) and (2.34), ie., they correspond to the same 
Nth-order differential equation. Through the selection of a transform matrix T 
arbitrary state models can be produced for a given differential equation. 

Some state models have special properties. For example, if the transformation 
matrix T is a modal matrix with regard to matrix A, then the new system matrix 
A. will be diagonal. The corresponding type of structure is called parallel form. 
An example of this form with one input and one output is shown in Figure 2.10. 
Here we assume that there is no direct path from input to output, i.e, D = D=0, 
and that the A has only single eigenvalues. The case of multiple eigenvalues is 
discussed in [19]. 

As A only contains values in the main diagonal, each state variable is only 
fed back to itself. A,.Ag,...,4x are the eigenvalue matrix of the system that, 
even with a real matrix A, can appear as complex conjugates. In this case, the 
corresponding state variables are also complex, but their imaginary parts cancel 
each other out to yield the real output signal y(t). 

The parallel form for a system with M inputs and A’ outputs is shown in 
Figure 2.11. Again it is assumed that there is no direct path from input to output, 
ie., D = D = 0 and that the system matrix A only has single eigenvalues. Blocks 
B und C represent multiplication with the corresponding matrices. The block 
diagram in Figure 2.10 is included as a special case; the central integrator stage 
clearly does not depend on how many inputs and outputs the system has. 

What use is transforming state-space if all of the resulting structures exhibit the 
same input-output behaviour? The strict equivalence between the different state 
models is unfortunately only valid under ideal conditions. Physical implementa- 
tions are always accompanied by interference that can be thought of as additional 
signal sources inside the system. For analog electrical systems this interference is 
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x(t) 


~ y(t) 


yol(t) 


nO yr) 


Figure 2.11: The parallel form of a system with multiple inputs and outputs 


noise, and for digital circuits and processors in the form of rounding errors. The 
effects of this interference on the output signal can be minimised through the ap- 
propriate choice of internal states. Additionally. some forms of realisation require 
less hardware or computation than others. 


2.6 Controllable and Observable Systems 


‘The parallel form yields a simple way of further classifying the properties of a 
system with simple eigenvalues. One property is the ability to control a state via 
the input and another is that a state can be observed by looking at. the output. 
For the structures previously described, it is possible that the input signal can 
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be cancelled out on its way to a particular state. This state is said to be not 
controllable. It can equally occur that a state-variable is cancelled while on its 
journey to the output. The output in this case is then said to be not observable. 

With the parallel form there is only one path from the input to each state 
and also from each state to the output (Figure 2.10). Elimination of more 
paths cannot occur. Accordingly, this applies to systems with more inputs and 
outputs (Figure 2.11). We can thus write the following definitions of the concepts 
controllable and observable: 


Definition 8: Controllable system 


A system ws satd to be controllable af after transformation to parallel form, no 
élements of the state matriz B are zero. 


A system ws satd to be observable if after transformation to the parallel form. 
no elements of the state matriz C are zero. 


In contrast. if the element Brym in row mn, colurnn m of B is zero, the state- 
variable z, from input «,, is not controllable. Equally, the state-variable 2, for 
output y, is not observable if the element Chn in row k, column 7 of C is zero. 

‘The advantage of this definition of the terms controllable and observable is the 
relative ease with which it can be verified from the elements of the state matrices. 
The disadvantage is that chosen systems must first be transformed to diagonal 
form for these properties to be assessed. There are other possible methods that. 
can be employed to test for observability and controllability, that work directly 
with the given (i.e. not diagonal) state model (e.g. [19, 23]). We now examine the 
method given above with the help of an example. 


Example 2.3 
Figure 2.12 shows a block diagram of a second-order system with two inputs 
and one output. At the first glance it seems that all of the states are connected 
to both inputs and the output. Whether any eliminations exist is uot obvious at 
this time. 
To determine the state matrices we read from Figure 2.12 an equation for each 
of 31 and 4 at the inputs of the integrator and an equation for y at the output. 


and then write these in the form of (2.33). (2.34): 


f 21 = ~4 —~6 ral —-2 3 vy 51 
ee - 3 5 29 | : ae a4 eeu) 
Oy i ae Oh 
rea aif] 
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x(t) 


X(t) — 


Figure 2.12: Block diagrain of the system in Example 2.3 


The matrices A. B, C, D can be immediately written down. The eigenvalues and 
eigenvectors can be obtained from the equation (A,E — A)t, = 0. 


~— —2 


The eigenvectors may, of course, be scaled by a constant factor. They form the 


modal matrix 
Tp. -1| +2 perk n 1 2 (2.54 
= 1 mae i ok i eee iE 2,04) 


that is at the same time the transformation matrix in parallel form. From (2.47 ) 
- (2.50) follows the state representation also given by the block diagram in Fig- 
ure 2.13: 


Here the element Bj, = 0, and it follows that the second state-variable is not 
controllable from the first input. No elements of C are equal to zero so it is a 
completely observable system. This is easily confirmed by the block diagram in 
Figure 2.13. If we want to control a particular internal state of the system in 
Figure 2.12 or the equivalent system in Figure 2.13, that is only possible from 
input signal we(t). 
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X(t) 


2.7 Summary 


At the start of this chapter we aimed to model continuous-time systems in the time 
domain. We found three types of model: differential equations, block diagrams and 
state models. ‘The starting point was a system model in which the ‘building blocks’ 
were represeuted by a network of ideal components. Although this is expressed 
in terras of electrical circuits it can also be applied to other physical structures, 
providing that the local non-linearities of the building blocks can be disregarded. 

We would finally like to combine the results obtained and show the relation- 
ships between them. Figure 2.14 shows the fundamental model forms, networks, 
differential equations, block diagrams and state models. 

It is not necessary to examine in more depth here the use of network analysis 
for the modelling of networks through linear differential equations with constant 
coefficients. The point we are making here is that from such differential equations 
we have discovered some extremely useful forms of block diagram. For some of 
these the coefficients can be taken directly from the differential equation, thus 
the name direct form is used. We have examined the direct forms L I and U1. 
of which If and TI are canonical forms, ie. they use the minimum number of 
integrators (as many as the order of the differential equation). Direct form I 
requires twice as many integrators, and is therefore not a canonical form. The 
input-output relationship of a system can be modelled by other forms of block 
diagram, although the coefficients of these are not immediately interchangeable 
with those of the differential equation. ‘The parallel form belongs to this group, 
which is notable as it makes the relationships between the input, intermediate 
states and the output particularly clear. 
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block diagram 


differential 


equation 
He: direct form Il 


direct form Ill 


parallel form 


g 


A diagonal matrix 


network AT Frobenius matrix 


A Frobenius matrot 


* Observe how the states are numbered 


Figure 2.14: Overview of the different model forms of LTI-systems 


Closely linked with the block diagrams is the state modcl. While the original 
differential equation is an equation of order N, the state model is a system of NV 
first-order differential equations. The numerous coefficients of these equations can 
be combined in the correct; way in a matrix forin to give the so-called state matrix. 
Allocation of internal states is equally as arbitrary as with the block diagrams. We 
resrict ourselves here to state models with a minimal number of states, as these 
correspond to block diagrams in canonical form. The elements of the state matrices 
can, in fact, be used directly to form a corresponding block diagram. Equally, every 
state model can be easily drawn as an equivalent block diagram. This makes it 
clear that there must be some kind of relationhip betwen the construction of the 
block diagrams and the structure of the state matrices. Accordingly the parallel 
form corresponds to a state model of diagonal matrix form A. The property of the 
direct form that makes its coefficients interchangeable with those of the differential 
equation must. therefore be present in the state model as well. The matrix A from 
the state model for direct, form IT is a Frobenius matrix (with suitable numbering of 
states). [t contains the coefficients of the differential equation in the bottom row, 


while all other matrix elements are cither 1 or 0. With direct form I, the same 
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is true for the transposed matrix A’. The elements of the Frobenius matrix can 
be taken directly from the coefficients of the differential equation. just as with the 
direct forms. For the non-canonical direct form I there is of course no applicable 
state-space structure with the minimum number of states. 

A state model can, in fact, be derived directly from analysis of a network. This 
method produces structures with state-variables that correspond to energy stores 
in the network. Derivation of block diagrams is not usually done directly, instead 
by way of the differential equation or state-space structure. 

Diagonal or Frobenius matrices are indeed useful, but are nevertheless only 
special forms of the state model. Any number of other state models can be obtained 
from the same input-output relationship through transformations. As every non- 
singular matrix A with single eigenvalues can be transformed to diagonal form, 
an easy rule can be obtained for the transformation of a non-diagonal state model 
with matrix A, into another likewise non-diagonal matrix Ay, (Figure 2.15). Tt 
should be observed in practice that T, and Ty are transformations in the same 
diagonal form, with the same numeration and scaling of states. 


TT." 


form 2 
system matrix Ao 


system matrix Ay }<qj——__——. 


diagonal form 


Figure 2.15: Transformation between different state-space representations 


The model forms in this chapter are only applicable to continuous-time LTI- 
systems that can be realised by networks with energy stores, and that can be 
characterised by ordinary differential equations. It should be mentioned here that 
LTl-systems exist. which can only be modelled by partial differential equations 
or difference equations. A special class of system that is modelled by difference 
equations will be dealt with in Chapter 14. 


2.8 Exercises 


Exercise 2.1 


Show that (2.3) describes an a) time-invariant and b) linear system. 


Exercise 2.2 


2.8. Exercises AL 


A system is modelled by the linear differential equation 


ay Oe eee 1&2 
eg age ge 


Of what order is this system? Draw block diagrams for this system in both direct 
forms I and II. Which of the two forms is canonical? Justify your answer. 


Exercise 2.3 


The following block diagram is in direct form II. Give a linear differential equation 
that corresponds to the same system. 


> y(t) 


Eixercise 2.4 
a) Draw a block diagram using differentiators. multipliers and adders that cor- 
responds to the following linear differential equation: 
aol + ayy + aay = byt + box 
Hint: Follow the construction stages for a direct form I block diagram. 


b) Redraw the block diagram in canonical form, What condition must be sat- 
isfied for this transformation? 


Exercise 2.5 


Ro = 100. 2) = 2. fg =5,C = 001. 


a) Draw a signal flow graph (=block diagram) using integrators, multipliers 
and adders. Select. an integrator output for each state in (2.31) and (2.32), 


b) Through elimination of states find a differential equation that models the 
input-output behaviour of the system. 
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c) Using the linear differential equation construct a block diagram in direct 
form fi. 


d) Are the block diagrams in a) and/or ¢) canonical? 
Exercise 2.6 


‘Transform the following signal flow graph of a system with one input and two 
outputs into a state-space representation. 


x(t) 


a) Select suitable state-variables. 


b) Represent the derivations of the state-variables as dependent on only the non- 
derived states and the input signal, and give the state-equation in matrix 
form. 


c) Represent both outputs dependent ou the non-derived states and (he input 


signal, and give the output equation in matrix form. 


d) Which special form does the block diagram have if d = 0? 


f) Is the system completely observable? From which of the outputs is it ob- 
servable? 
Exercise 2.7 
A system is modelled by the linear differential equation y + 4y + 5y = 2% + 7x. 
a) From the linear differential equation give a corresponding state-space repre- 
sentation. 


b) Transform the state-vector using a suitable matrix T with z= T-1z. so 
that the system matrix A has a diagonal form. Give the matrix T and the 
transformed state equations. 


What are the eigenvalues of the system matrix? Has the transformed system 
the same input-output behaviour? 
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c) Is the system controllable, and is it observable? 
Exercise 2.8 


a) Give the transformation matrix T and T~! for the transformation of the 
states z in (2.36) and (2.37) to the states ¢ in (2.38) and (2.39), so that 
z= T¢ holds. 


b) Verify the equations (2.40) - (2.43) using the relationships a, = ay—, and 
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3 Modelling LTI-Systems in the 
Frequency-Domain 


In the last chapter we represented signals exclusively in the time-domain. This 
has the advantage that differential equations can be used to create system models. 
LT I-systems of any size can, in fact, be dealt with using these techniques, although 
calculations become cumbersome and complicated with higher order differential 
equations or with state models of many variables. Jt is for this reason that, we have 
not yet derived expressions for the output signal of LT L-systems using differential 
equations. 

Are there any other techniques available for representing signals? As an ex- 
ample of an acoustic signal we will consider a chord; a combination of different 
notes produced by a musical instrument. The vibrations can be represented as a 
function of time if a time-domain representation is required, but it is obvious that 
a chord can also be described by its component notes. The individual notes are 
characterised by pitch ——- or expressed technically —- by their frequency, as the 
maumber of individual oscillations per unit time. 

The characterisation of a signal by the the frequencies of the separate oscilla- 
tions has advantages, not only for musicians. but also for technical reasons. Many 
systems are known to produce a sinusoidal output signal if a sinusoidal input sig- 
nal is introduced. The amplitude and phase shift of the output signal may have 
changed relative to the input, but the frequency remains the same. We will soon 
see that LTI-systems have exactly this property. In general, the effect on the phase 
and amplitude are different for each frequency, and the knowledge of this effect. for 
all frequencies presents itself as a further possiblity for modelling systems. This 
kind of model is called a frequency-domain model and is often simpler to handle 
than a time-domain model. 

The response of an LTI-system to an input signal in the frequency-domain can 
be derived by using the following procedurc. 


1. Analysis of a sinusoidal input signal for a range of frequencies. 


2. Establishing the system response to the individual frequencies by recording 
the amplitude and phase difference for each one. 


3. Combining the individual parts to give a picture of the complete output 
signal, 
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These points will each be examined in detail in this and the following chap- 
ters, but firstly we will take a general look at the concept of frequency and the 
representation of signals in the frequency-domain. Mathematical tools for the 
transition between the time-domain and frequency-domain follow in Chapters 4 
and 6 (Laplace Transform) and in Chapter 9 (Fourier Transform). 


3.1 Complex Frequencies 


3.1.1 What is a Complex Frequency? 


The traditional definition of frequency is derived from real values of a sinusoidal 
signal a(t). Such a signal is characterised by its amplitude X and the number 
of oscillations per unit time f, and the zero crossing relative to time t = 0. The 
frequency f is a real number. Together with the real phase y it describes exactly 
the position of all zero crossings: 


a(t) = Xsin(Qaft+y). (3.1) 


‘The extension of the concept of frequency to a complex value leads to a complex 
exponential signal of the form 


a(t) = Xe", (3.2) 


In contrast to (8.1) only the time ¢ is real; the amplitude X and the frequency 
s=o-+ jw are complex. Figure 3.1 shows an example of a complex exponential 
signal with X =1+) ands = —0.54 95. It is defined for all points in time, 
but is only shown here for t > 0. For ¢ = 0, x(t) takes the value of the complex 
amplitude X; for t > 0 it is defined by the real (7) and imaginary (w) parts of s. 
The real part is known as the modulus of x(t), 


{a(t)| = {Xle”’, (3.3) 


while the imaginary part corresponds to the angular frequency w = 27f, and 
indicates how fast the complex signal (Figure 3.1) orbits the time axis. The re- 
lationship with real oscillations can be seen by separating the real and imaginary 
parts of a(£), as in Figure 3.2, 


3.1.2 Complex Frequency: Example Signals 
s, x(t) is of course real. In the simplest case s = 0 and X = 1, so x(t) = 1, and 


has become a constant. A real exponential signal is obtained for other real values 
of s, for example, x(t) = e~*! for ¢ = —3. Sinusoidal signals with real values can 
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a(t)= Xe* with X¥=14+7, s=-0.5+ 95 


Tra {x(t)} 


Figure 3.2: Real and imaginary parts of the signal in Figure 3.1 
-) ey © oO 


be represented by superimposing two complex exponential functions with purely 
imaginary frequencies s = jw and s = —jw. Superimposing exponential functions 
with o 4 0 leads to decaying or growing sinusoidal oscillations. 
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Table 3.1: Examples of some real signals 


eee: i _ 
Signal Frequency 
ree ateoest 7 — 
Constant a(t) = 1 ar 
Real foc ce eS 
exponential sig- | a(t) = e%* A ks 
ett ee a Ok Mente octet : 
: x(t) = sin 50t 
Sinusoidal mY) 1 : : 450: 
oscillation = ar ed0it _. @~ 50it) = OU) 
J 
firs — pees ea 
. = en2teint 
Hecdand a(t) e ~ sin 50¢ beeen 
oscillation = = jet a aeal = ama S$ os —2-+ 90) 
4) 
= ee ern Coe ene CR Sere teres ere 


3.1.3 The Complex Frequency Plane 


The advantage of complex frequency is that many kinds of signal can be expressed 
by a single complex frequency parameter. To give an overview, the different forms 
of complex exponential function can be assigned the corresponding values in a 
Gaussian number plane. It is called the complea frequency plane or s-plane. Fig- 
ure 3.3 shows the complex exponential functions for different locations in the 
complex frequency plane. Moving away from the real axis makes the oscillation 
faster. Looking in the direction of the time axis, in the upper half-plane where w 
is positive, the complex oscillations turn clockwise, and in the lower half they turn 
anticlockwise. On the real axis the signal does not oscillate. Signal forms in the 
right half of the plane grow — faster if they are further away from the imaginary 
axis - and signal forms in the left half of the plane decay. 


3.2 Eigenfunctions 


3.2.1 What are Kigenfunctions? 


In general, there is no great similarity between the time behaviour of a system’s 
input and output signals. There are systems. however, that allow certain input 
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Figure 3.3: An illustration of the complex frequency plane 


signals to pass through unchanged, for example, electrical networks made up only 
of resistances, capacitors and inductors. Their response to a sinusoidal signal is 
usually (for linear components) another sinusoidal signal, with only the amplitude 
and phase being different. Sine and cosine functions can be put together from 
exponential functions (see Figures 3.1 and 3.2), and then the amplitude and phase 
changes can be expressed by a single factor, the complex amplitude. The output 
signal can then be obtained from the input signal by multiplication with a complex 
factor. 

A similar phenomenon is known from linear algebra: for certain vectors x. the 
product of x with a matrix A equals a multiple of the vector x: Ax = Ax. Then 
x is called eigenvector and X is called eigenvalue. We will use these notions also 
for signals which pass through a system without changing their shape. 


Definition 10: Eigenfunction 


A signal e(t) which when input into a system. produces at the output the re- 
sponse y(t) = Ae(t) with the complex constant A, 1s called the eigenfimction of 
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Figure 3.4 shows the close relationship between the input and output signal. 


Figure 3.4: Driving a system with eigenfunction e(t) 


3.2.2 Eigenfunctions of LTJ-Systems 


As sinusoidal signals pass through linear networks without changing form, and 
can also be represented by complex exponential functions, we guess that these 
exponential functions are eigenfunctions of LTI-systems. We have to show that 
y(t) = Aw(t). To prove our theory, we start with an input signal of the form 
x(t) = e*. and look for the corresponding system response y(t), that we can write 
in a general form as a function of the input signal: 


y(t) = S{ee)} . (3.4) 


In the following we use exclusively the stated properties of LTJ-systems, time- 
invariance and linearity. We start with the response to an input signal shifted in 
time. 

a(t — c) = ett) (3.5) 


and because of the time-invariance we obtain 


u(t — c) = S{a(t— d} = S{e"P} = Sfe*Fe"t} (3.6) 


The factor e7°* 


that 


does not depend on time. Because of the linearity it follows further 


y(t — c) = S{e~*%e"} = e* *S{e™} = e7°“y(Z) . (3.7) 


Now although we do not have y(t) itself, we have a difference equation for y(t) 
which is 


y(t — z) =e **y(E) . (3.8) 
This can be fulfilled by 
y(t) = Ae* (3.9) 


which can be verified by substituting into (3.8). From Definition 10, x(t) = e* is 
an eigenfunction of the LTI-system described by 5. 

The constant A identifies the behaviour of S. As linearity and time-invariance 
were the only pre-conditions, we cannot say anything further about A. In general 
\ depends on the complex frequency s. We write therefore \ = A(s) and call 
H(s) the system function or transfer function, as it describes the system and its 
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on 
1 aon 


transfer properties from the input to the output. The connection with the system 
model in the time-domain will be covered in later sections. Figure 3.5 shows the 
relationship between eigenfunctions and system functions for LTJ-systems. 

The scheme given in Figure 3.5 has to be used with care. For many [I'l- 
systems, an analytically determined transfer function H{s) is only valid within 
a certain region of the complex plane, the so-called region of convergence. Only 
inside this region, a complex exponential oscillation at the input leads to a finite 
signal at the output. As an example, consider an integrator with the transfer 
function H(s) = i, The response of the integrator to the input signal z(t) = e** is 

é 
only of finite amplitude, as long as Re{s} > 0. The response y(t) = [ e°° dz does 
not converge for Re{s} <0. Usually. the indication of the region of convergence 
for a transfer function is omitted without running into problems. We will discuss 
this topic further in Chapter 8.4.4. 


Figure 3.5: Eigenfunction and transfer function of an LTI-system 


One more warning: the one-sided exponential function 


BR tee 
We t£>0 
a(t) = { 0 otherwise 


is in general not an eigenfunction of an LT]-system! 


3.2.3 Example: RLC Network 


As an example for analysis using complex frequencies we consider the parallel 
resonant circuit in Figure 3.6 


i(t) R=1 kQ 


C=100 uF 


Figure 3.6: Parallel resonant RLC network 


u(t) 
L=100 mf 


The input signal is of the form 


u(t) = uge?! cos(wot + Yo) - (3.10) 
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To determine the expression for the current i(¢). first u(t) is rewritten as two 
complex exponential functions: 


u(t) = uger" os eliarhee) te arn) = Uy et! Be Uner2! (3.11) 
with ‘i 
r ook 0 yen, I 64 
U, = U2" = ee 74, = $2" = Og + Jwo. (3.12) 


We can find the expression for current z(t) with the following considerations. 
e The input signal is a sum of two exponential functions. 


e The electrical network can be modelled by a linear differential equation with 
constant coefficients. and is therefore an LTI-system. We know that LTL 
systems have complex exponential functions as eigenfunctions. 


e The output signal may be then be written as the sum of two exponential 
functions. 


For the current we thus make the following starting point: 
i(t) = Tye**? + Ine*?" (3.13) 


The constants J; and Iz are unknown and must be determined from the model of 
the network. We put u(t) and i(t) into the differential equation 


cult) 


u(t} + LC ) 


= Ri(t) +L 


ato ercRE® (3.14) 


that can be immediately written down from the circuit in Figure 3.6. The following 
equations are then obtained 


U,e%!* + 38] nee = Riye*"* + Lsy Tes" + LCRs?I,e%* (3.15) 
Unes?* + s2LCUze = Ripe + Lsghe™! + LORsghe*. (3.16) 


As U, and U2 are known from (3.12), we can solve (3.15) and (3.16) for Jy and Jy: 


1+ s?LC 

oe fae 3.17 

h M1 TR+seiL+s2LCR on) 
1+ 83 2 LC oe 

no yi ; 3.18 

Ip Us R+ sob + 822LCR om) 


As with (3.12) 8; = s2*, it follows from (3.17) and (3.18) that J; = Ig*. The 
objective is then obtained with (3.13) 


a(t) = Tye + Iy*e"* = WRe{Ie*"*} . (3.19) 
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As an example. we input the component values in Figure 3.6 


a ne 
uy = 20MV. wy = 300872, og =—Is7*. yo = = & 0.785 


into (3.17) and obtain 
Le oop 


Together with (3.19). the result for a(t) is: 
i(t) = 19.5pAe ‘* cos(30087't + 0.49) . 


The following observations taken from this simple example are important for the 
general procedure. 


® To obtain the desired output value we only have to determine the factors of 
the eigenfunctions (here J; and J). 


e@ These factors can be expressed as algebraic equations (here (3.17) 
and (3.18)). 


® The differential equation that models the network (here (3.14) ) does not 
have to be solved as a whole. Forming the derivative or integral for each 
individual inductance or capacitance is sufficient. Due to the exponential 
form of the eigenfunction each derivation or integration results simply in a 
multiplication or division by the complex frequency s. 


e This procedure corresponds to steady-state sinusoidal analysis. Here, how- 
ever, exponentially decaying or rising oscillations are also included. 


The convergence of the system response has not been investigated in this ex- 
ample. but was simply implicitly assumed. We will see in an exercise at the end 
of Chapter 8 that the system response only converges for a known range of values 
of do. 


3.2.4 Impedance 


From the example of the parallel resonant circuit we made the observation that 
the treatment of the equations for the capacitances and inductances can be bro- 
ken down to multiplication or division by the complex frequency s. Such networks 
‘an be modelled without the use of differential equations or integrals, if every 
component is given a complex resistance that is dependent on the complex fre- 
quency. This complex resistance is called ampedance. If the voltage and current 
are in exponential form for the components. Olim’s law can be used to define the 
relationship between them: 


U(s) = Z(s) - I(s) (3.20) 
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‘Table 3.2: Impedance of important components 


k component impedance 
R 
resistance ac NS a, R 
: I 
capacitance o-— }——-o < 


inductivity 


with the impedance Z7(s), This relationship is called Ohm’s law in impedance form. 
Table 3.2 shows the impedance functions for the most important components. 

Networks that consist of these components can be modelled as an impedance. 
Taking the equations (3.15) and (3.16) for the parallel resonant circuit we compare 
with (3.20), and have: 

Ue®* = Z(s) + Te* (3.21) 

where 
sL- al _R+sh+ s*LCOR 
sL+a 1+89LC 


From section 3.2.2 it follows that the system function of the parallel resonant 
circuit for the voltage as input signal and current as output signal is: 


(3.22) 


1 Lee hCG 


ENS) Fy Rr tk 


(3.23) 


The output value of the parallel resonant circuit can also be expressed in a general 
form: 
i(t) = H(s,)U,e*" + H(s9)U2e*?* . (3.24) 


The impedance model is only applicable to linear time-invariant circuits (LTI- 
systems), as only they have exponential functions as eigenfunctions. 
3.2.5 Normalisation 


A general problem with derivation of the system response and the specification of 
the system function is the correct consideration of physical units of measurement. 
There are two fundamental possiblities: 


® consistent use of units 


on 
wrt 
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@ normalisation. 


The advantage of consistent use of units is that all values have a physical 
meaning and that errors in calculation can be detected due to inconsistency of 
units. Unfortunately this method often leads to unwieldy expressions. We will 
demonstrate consistency of units with the following simple example. 


Example 3.1 


The system function of the network shown in Figure 3.7 will be derived. The 
voltage u,(t) is the input signal, w2(t) the output signal. 


C= 10uF 


u(t) =e(t) LV || R=lOAQ | u2{t) =? 


Figure 3.7: RC circuit 
Using the complex impedances of the components 


gy NT es ee Re Gots (3.25) 
Uj(s) Rick: st+1 


sC 


is obtained. The complex frequency variable s has dimension 1/unit time, and the 
time constant c= RC’ the dimension unit time. 


The advantage of normalisation is simplicity of expressions, especially when 
numerical values are given. Admittedly, the physical meaning of the values is 
no longer immediately apparent, and errors in calculation cannot be found by 
considering the physical meaning. As dealing with normalised values and their 
correct interpretation requires some practice, we will examine the relevant: concepts 
here in some detail and finally demostrate them in an example. 

Two steps are required to convert a network to normalised values. 


e Amplitude normalisation 


With amplitude normalisation, all voltages are expressed as dimensionless 
multiples of a reference voltage, and all currents as a multiple of a reference 
current. Amplitude normalisation causes a change in the vertical axis. 
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e Time normalisation 


With time normalisation, all specified times are expressed as multiples of a 
reference time. Time normalisation causes a change in the time axis. 


Both armplitude normalisation for voltage and current and time normalisation 
induce a corresponding component normalisation, which expresses all component 
values as a multiple of the corresponding reference value. 

The simplest possibility for the choice of reference voltage, reference current 
and reference time is the use of the corresponding SI units, 1V. 1A and 1s. From 
these, reference values for the components are immediately obtained, also in SI 
units, ic. 10 for resistances, 1F for capacitances and 1H for inductances. Nor- 
matlisation can thus be carried out so that all values are calculated using SJ units. 
Simply omitting these units gives a normalised representation which can be con- 
verted back to a physical representation by adding SI units. However, values for 
capacities in 1F are very unwieldy, as well as time constants in seconds when 
dealing with fast microelectronic components. 

We therefore discuss in detail amplitude normalisation, time normalisation, and 
component normalisation for general reference values. From now on, we denote 
normalised quantities by a tilde (~ ). Since we want to represent components by 
impedances, the following considerations are based on complex frequencies. 

We begin with amplitude normalisation and mark the reference voltage with 
Uy and the reference current with fy. Both are dimensionless. time-independent 
variables. For current and voltage in normalised variables. it follows that. 

on (3.26) 
Uy Io 
For time normalisation we relate all times t to a reference time ty and obtain the 
dimensionless normalised time ¢ j 
t i 
When we are working in the frequency domain, we express the complex frequency 
likewise with the reference time to. We have to make sure that the argument in 
the exponential function remains dimensionless. We obtain from 


(3.27) 


et = esto . t/t = gust (3.28) 
the normalised complex fequency 
§ = stg. (3.29) 


The transition from the amplitude and time normalisation to component nor- 
malisation is carried out using (3.20). First we express U(s) and I(s) in amplitude 
and time normalised values with (3.26) and (3.29): 

U(8/to) Zhe I(8/to) 


U(gs)=— Taj= mara (3.30) 
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If we use the normalised complex frequency variable § in (3.20) and substitute 
into (3.30). it follows that (3.20) is the corresponding relationship for the nor- 
malised value of impedance 


U(a) = Z(8)T(8). (3.31) 


The normalised impedance 7(4) corresponding to (3.30) follows by normalisation 
of the impedance Z(s) with respect to the reference resistance Ro 


=. 2(%/to) Uo on 
Ree hee 3.32 
(3 Re | ae eee) 


The reference resistance Rg is thus clearly set by the amplitude normalised ref- 
erence voltage Ug and reference current fy. The normalised impedances of the 
frequently occurring components from Table 3.2 are: 


R = . 

—=R resistance 
op to 1 3 ay 
ACS) = ~ ~ == capacitance 3.33 

( ) 8RoC 8c! a \ 
._ - = 
§—— =s5L inductance 
Roto 


The reference resistance Ro and the reference time ¢ = 0 can be combined to give 
a reference capacitance and a reference inductance 


ty 


=, Lin = Roto. 3.34 
RB, Q oto ( ) 


and the dimensionless normalised component values can then be obtained 


e R & C Pe L 
ieee. CS. (==, (3.35 
t= 5 G re 3.35) 


They are normalised to the reference values for voltage, current and time chosen 
at the outset. Conversl, it is also possible to use the three reference values for 
resistance, capacitance and inductance as a starting point. Then the inverse route 
has to be followed to interpret the results in the correct dimensions for voltage, 
current and time. The choice of the reference values yields handy values, when 
the reference time is in the same order as the typical time constants of the sys- 
tem. Component reference values are chosen such that, manageable values result. 
With some practice, normalisation can be significantly shorter than the detailed 
representation shown above. 

We show the procedure with the same simple network from Example 3.1 that 
we have already analysed with dimensional values. 
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Example 3.2 
To derive the system function of the network in Figure 3.7, we select. reference 


values for current, voltage and time and calculate from these the reference values 
of the components. With 


Up = 1V, Io =imA, to = Is 


we obtain 


Ro = 1k, Co = ImF 


for the reference values of the components and from those, the normalised compo- 
nents 


~ ~ 1 
R=10, C=. 
100 
The system function is then given by 
i(3) = U8) RR 0 8. (3.36) 
ae 5 nee 1 7 0 é+ 10° . 
TH) zp 194i F410 
gC 8 


Here all quantities are dimensionless and the result of further calculation can be 
interpreted respectively as normalisation into volts, milliamperes and seconds. 

Usually no separate notation for the normalised quantities (the tilde in our 
case) is used. The component. values are simply given without dimensions. This 
representation of the dimensionless network is shown in Figure 3.8. From now on, 
we use both variants for the analysis of systems without denoting normalised and 
unnormalised quantities differently. 


C=0.01 
°- a -o 
u(t) = €(t) R= 10 u(t) =? 
—. 5 


Figure 3.8: Normalised RC circuit 
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3.3 Exercises 


Exercise 3.1 


Recognise the frequencies of the following signals in the complex frequency plane. 


aa(t) = e 7 (1+sin5t) 
ap(t) = A coswot+ B cos 2wyt 
g(t) = sin(w,t+) 


Exercise 3.2 


Could the following systems be LTI-systems? 


a) 222 
sin(wt) 5 cos(wt + 20°) 
b) ~| 272 -——» 


4 sin(10t) cos(5t) 


e72at —5 cos(2t) 


€) al 99 


+» . 
—5 cos(2L) e-32t 


Exercise 3.3 


The following simple network will be analysed: 


L#12H Cslip 


uy (t) = e7* 1/8 cos(—4¢-1/s)-1V 
a) Normalise the components and the response to LA, 1V and 1s. 


U2(s) 
U; (s) 


b) Give the transfer function H(s) = 


by applying Ohm’s law in 


impedance form. 
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c) Represent uw (¢) as a sum of weighted exponential functions and calculate 
the system reaction u(t) to the exponential excitation. 


d) Express ua(t) using physical dimensions. 


Exercise 3.4 


Show that 


ee! £>0 
A { 0 otherwise 


t 
is not an eigenfunction of the LTT-system y(t) = | a(ejde. 


me OD 


4 Laplace Transform 


4.1 The Eigenfunction Formulation 


In Chapter 3 we saw that for input signals 7(t) = e%’, that are eigenfunctions of 
a linear time-invariant system (LTI-system), it is relatively easy to calculate the 
corresponding output signals. Unfortunately. real world signals (see Chapter 1), 
are not eigenfunctions of LTT-systems. There is a way around this, however, where 
any signal x(t) is represented by superimposed eigenfunctions e*’ with different: 
frequencies. The response of an LT I-system to the individual eigenfunctions can 
be easily determined and then with the superposition property, the response to 
the signal c(t) can be put together. 

The idea of analysing a signal as its individual components is already famil- 
iar from the Fourier series: periodic signals can be represented as a combination 
of harmonic oscillations. Their frequencies must. be integer multiples of the fun- 
damental frequency that represents the periodic signal, and the combination of 
these frequency components is achieved by summation. We are not restricted to 
periodic signals, so we must permit analysis in eigenfunctions with any frequency. 
The superposition then consists of an integral over the possible frequencies. This 
idea can be put into use in various different ways and it leads to the Laplace and 
Fourier transforms. 

In this chapter we will discuss the Laplace transform, starting with the defini- 
tions of the unilateral and bilateral Laplace transforms, and then considering some 
examples that lead to some general rules for the region of convergence. Finally we 
will discuss some important laws and properties. 


4.2 Definition of the Laplace Transform 


In order to be able to represent a signal x(t) as a superposition of individual parts, 
two mathematical tools are required for: 


® the decomposition of «(t) into parts, 
® the superposition of the parts of the complete signal x(¢). 


Mathematical formulation of the decompositon leads to the definition of the 
Laplace transform 
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Definition 11: Laplace transform 


The Laplace transform of a function a(t),t € IR 1s 


Lia(t)} = A(s) = / a(t)e* dt (4.1) 


for the the values s € ROC CC, for whach the wmproper integral exists. 


L 


The complex function X(s) is called the Laplace transform of x(t). Stating the 
convergence is not necessary as whatever form the function a(t) has. the integral 
only converges for a bounded region of the complex s-plane. This region is called 
the region of convergence (or ROC). We deal with determining the region of con- 
vergence with some examples, when we are more comfortable with the Laplace 
transform. 

In order to reconstruct a(t) from the individual terms, the reverse operation 


to the Laplace transform must be used. This is the inverse Laplace transform: 


1 OJ OO 
Se Xe = =f X(s)e"ds . (4.2) 


297 Jo=gec 


The real number o determines the location of the path of integration within the 
complex plane. It must lie within the region of convergence, but its exact location 
and form does not influence the result. An example is given in Figure 4.1. The 
region of convergence in this case consists of a vertical stripe in the complex plane, 
and the path of integration (dotted line) runs vertically from top to bottom. 


Figure 4.1: Hlustration of the Riemann sum 


The Laplace transform represents the real or complex function of time x(t) by a 
complex function X(s) that is defined in the complex frequency plane. Important 
functions encountered in practice only have one transform, so X(s) fully describes 
x(t) (see Section 4.6). 
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The pairing of a function of time x(t) and its Laplace transform X(s) = £{x(t)} 
can also be identified by the symbol o—e. The filled circle denotes the frequency- 
domain quantity: 

x(t)o—eX(s). (4.3) 


The inverse Laplace transform really does represent a function of time as an 
infinite number of superimposed exponential functions, and this can be made clear 
by the integral (4.2), sketched in Figure 4.1, and expressed as a Riemann sum: 


1 fotsee 
a(t) = y X(s)e*'ds 


20) Jo—s00 


= 5 jim, {... + X(so)e%* + X(s,)e*'! + X(sg)e”! + ..} As (4.4) 


Every term in (4.4) is a complex exponential function, weighted with a complex 
factor. 
4.3 Unilateral and Bilateral Laplace Transforms 


The Laplace transform has more than one version and, as well as Definition 11, 
the following unilateral Laplace transform 


Lz{a(t)} = X(s)= fo xyemar, (4.5) 


in which the domain of integration only contains the positive values of the time 
axis, is often used. It assumes that the system is zero for t < 0 and is therefore 
well suited to causal systems and problems with initial conditions. Modelling of a 
left shift, though, is now problematic. 

To distinguish between the two types of transform, the transform in Defini- 
tion 11 and equation (4.1) is called the bilateral Laplace transform. It transforms 
t for ¢ € IR and models a left shift of the signal in a simple way. If a causal signal 
or system is multiplied by the step function 


1 fort >0 ? 
et) { 0 otherwise (4.6) 


then its value is zero for t < 0, and it can be dealt with by the bilateral Laplace 
transform as with the unilateral Laplace transform. Figure 4.2 shows the step 
function in the time-domain. Use of the step function will be explained in the 
following examples. 
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(ft) 


Figure 4.2: Time behaviour of the step function 


4.4 Examples of Laplace Transforms 


The following examples should clarify the connection between the unilateral and 
bilateral Laplace transform and the use of the step function. The region of con- 
vergence will also be determined. 


= Example 4.1 
We begin with a decaying exponential function that disappears for time t < 0. 
Tt could, for example, be the impulse response of an RC circuit. i.e. a causal 
system. ‘The constant a is real: 


a(t) = e~*e(t) . 


Its Laplace transform X(s) = £{x(t)} is required. We obtain through the Laplace 
integral (4.1): 


Od WO 
DUS) ices . ete(neat = | e (start de 


oo 0 


a t=oc “4 ; 
= ~1 (tae 3 Di p-etayt_y) a 
4 t=x0 S +A Lhemos sta 


We consider the effect of the step function in the bilateral Laplace transform 
because we evaluate only positive values of time t in the integral, that is, where 
the step function has the value 1. This has the same meaning as the unilateral 
Laplace transform of e~**. The limit value of the exponential function for ¢ — oo 
only exists if the real part of the exponential function is negative. i.e. for the values 
of s where Re{s} > -a. For all other values of s the integral does not converge, 
and it is said that the Laplace transform does not exist. Concisely put: 


1 
Lie(the7™™} = ——— :  Re{s} > -a. 4.7 
{e(te""'} = —— Res} (4.7) 
The transform clearly has a pole at s = —a (see Section 4.5.2). The region of 


convergence in the s-plane is represented in Figure 4.3. It contains all values of 
s for which the real part is greater than —a. We can also express this in another 
way: a vertical line through the pole divides the complex plane into two halves. 


4,4. Examples of Laplace Transforms 65 


ee 


no “of Assi 
Of fe Ses converges 
nvergence GY i } 
converg (4 yy a Miiiititie 
? ae : : 
-G Af, : AY 
G7 Yy 
LM d 


Figure 4.3: Representation of the region of convergence from Example 4.1 


The Laplace transform exists for all values of s that are in the right hand side. 
For a = 0 we obtain an important special case: The Laplace transform of the step 
function é(t): 


Lfe(t}} = u >; Re{s} >0. (4.8) 


Bat Sie Example 4.2 


In the second example we consider an exponential function that disappears for 
t< 0: 


a(t) = eT ts e(—t) : 


To determine the Laplace transform we proceed exactly as in the first example: 


XS 
X(s) = - | eM e(—t)e7 dl 
om OX 
: so (sa) op. 1 —(stayt 1 
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and obtain 
I ; 
L{-«(—t)e} = > Re{s} < —a. 4.9) 
{-e(-#}e“*"} = —— Refs} (4.9) 
The Laplace transform X(s) has the same form here as in Example 4.1 and so 
iikewise has a pole at —a. ‘The difference lies in the region of convergence, which 
here is the half of the plane on the left side of the vertical linc. It is clear that 
different time functions can have the same Laplace transform. so to invert the 
transform, the region of convergence must be the deciding factor between the 
different, possibilitics. 
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Figure 4.4: Ilustration of the region of convergence from Example 4.2 


Example 4.3 
In this example, we form a right-sided signal from two exponential terms from 
Example 4.1: 


a(t) =e(i)[e* +e7"*) 


‘To determine the Laplace transform, we split z(t) into two parts and interpret for 
each part the result of Example 4.1: 


x(s) =f fe~te(t) Fe *e(Dle~ "dt = ii ete dt +f ee Ft 
) ( 


ares Jo 
1 1 
= - = i 
s+l s+2 
The Laplace transform X(s) has two poles at s = —1 and s = —2. As X(s) only 


exists if both parts converge, the pole with the largest real part determines the 
region of convergence. Put in other words: the region of convergence lies to the 
right of a vertical line through the rightmost pole. Through combination of the 
two terms, it can be seen that X(s) has a zero at s = ~1.5, but this has no effect 
on the region of convergence: 


1 1 28+3 
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Example 4.4 


Now we consider a signal that is not equal to zero for —-oc < ft < oc and is 
formed from a right-sided signal for tf > 0 as in Example 4.1, and a left-sided signal 
for f < 0, as in Example 4.2: 


a(t) = e(t)e7™ ~ e(—t)e™®. 
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Figure 4.5: Illustration of the region of convergence in Example 4.3 


We again express the Laplace transform as its component parts and then have 
the same form, and so the same poles as in Example 4.3. ‘The region of conver- 
gence is made up of the area in the s-plane in which both parts converge, i.c. in 
the intersection of the two regions of convergence of the exponential parts from 
Example 4.1 and Example 4.2. The fact that both regions of convergence of the 
individual terms overlap, means that the the region of convergence lies in the strip 
between the two poles: 


1 ae ae 
s+2  s+1  5824+38+2’ 


2< Re{s} <1. (4.11) 


Lez Im{s} 


pole: s = ~—l,s =-2 


ee, Pxample.4.5 


The signal in this example is similar to that in Example 4.4, but the values af 
the exponents for the left and right sides have been exchanged: 


z(t) = e(t)e~* — e(~t)e™™* . 
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Each part converges seperatcly; the positive time part for Re{s} > ~1. and the 
negative time part for Re{s} < —2. In comparison with Examples 4.1 and 4.2, 
we see that in this case the regions of convergence do not overlap. This signal 
therefore has no Laplace transform. 


4.5 Region of Convergence of the Laplace Trans- 
form 


The Examples 4.1-4.5 are concerned with signals of which the Laplace transform is 
characterised by a few simple poles and zeros. Finding the regions of convergence 
was relatively simple. The Laplace transform can also characterise. however. more 
complicated signals and systems, and leads to expressions that can no longer be 
written as rational functions of s. 

That is the case, for example, for all locally distributed systems like electrical 
circuits (see [19}). We must therefore make the results so far obtained even more 
general. First of all we will consider the convergence with indefinite integrals. 
The region of convergence is especially important, because different signals can 
have the same Laplace transform and are only distinguished by their regions of 
convergence (see Examples 4.1 and 4.2). Without giving the region of convergence. 
a unique inverse transform is not possible in general. Further on we will consider 
general singularities of functions of complex variables. 


4.5.1 Indefinite Integrals 


First of all we recall the meaning of integrals with infinite limits of integration 
in (4.1) and (4.5). Unlike an integral with finite limits 0 and a < oc, an integral 
between 0 and oo is defined by the limit 


| “ildt = tim. i ‘at (4.12) 
JQ JQ 


It is also called an andefinate mtegral. Correspondingly. the integral of the bilateral 
Laplace transform is given by two limits 


XS 


B C 
a(tje dt = | a(t)e*'dt + lim i a(tye dt. (4.18) 
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Here. each limit must converge individually (in previous examples B was always 
zero). The region of convergence of the bilateral Laplace transform therefore 
consists of the intersection betwecn the two regions of convergence for the two 
limits. 
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4.5.2 Singularities 


The Laplace transforms from the previous examples are functions of the complex 
variable s. For certain values of s they were singular (e.g. for s = —a@ in (4.7)). 
To classify such situations in complex s-plane we must recall some concepts from 
function theory. 

If for a complex function X(s),s EC at sp, the boundary value 


(4.14) 


exists and takes the same value X’(so) regardless of the path sy is reached by, the 
function X(s) at the point sp is then called an analytic, regular or holomorphic 
function. X(s) at the point sq is said to be complex differentiable and X/(sp) is the 
first derwative of X(s). If the first derivative exists, then the higher derivatives also 
exist at this point. Points for which X(s) is not analytic are called szngularzties. 

Functions X(s) that are analytic in the entire complex s-plane apart from some 
isolated points are often obtained as Laplace transforms. The local behaviour at 
any isolated point so, which has a surrounding X(s) that is analytic. can be 
classified by the Laurent expansion of X(s) with so 

x 


(she ye An (S — 89)” (4.15) 
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The following may occur: 


e The Laurent expansion does not contain any clements with negative powers 
(a, = 0 for n < 0, Taylor series), X(s) is then analytic at the point sp. 


e The Laurent expansion contains a finite number M elements with negative 
powers (a, = 0 for n < —A? < 0). X(s) is then not analytic at the point so. 
The singularity is then called a pole of order M. 


e The Laurent expansion contains an infinite number of elements with negative 
powers. X(s) is then not analytic. The singularity is called an essentzal 
singularity. 


This classification is of little use if the Laurent series of X(s) is not known. The 
Laurent expansion of functions that occur when LT l-systems are described by the 
Laplace transform are, however. usually simple to determine. As an example, we 
will consider the Laplace transform from Example 4.4. 


a nnn example 4.6 


To determine how the function X(s) from (4.11) behaves at the point s = —1, 
we re-write the first term and expand it into a geometric series 
: =o (s+i}]". js+ib<il (4.16 
= . = i—(8 4 . ‘ r< S coe 
sF21-Fistn ot | ) 


70 4. Laplace Transform 


The condition |s +- 1] < 1 for the convergence of the geometric series is certain to 
be fulfilled for any small area around s = —1. With (4.16) the Laurent expansion 
of X(s) from (4.11) is yielded: 


{ 1 cele (—1)" n > 0 
xX S} = = ,, ; ne zi 4 "| = oS 
(s) ae: + FATS >» an(8+1)" with ay 1 n. 1 
NWS HOD 4) mo~-dl. 
(4.17) 


We have found that a, = 0 for n < —1, and therefore X(s) has a first-order pole 
(single pole) at s = —1. 


In the context of analysing LTI-systems that have a finite number of energy 


stores, rational fraction Laplace transforms often occur. For a numerator polyno- 
mial of order M they can have up to M poles, but no essential singularities. 


4.5.3 Properties of the Laplace Transform’s Region of Con- 
vergence 


The properties that we observed in the examples from Section 4.4 can be gen- 
eralised for more complicated signals. We will list the series of properties that 
are obtained. They are each concerned with a time signal x(t) and its Laplace 
transform X(s) (4.1). 


1. The region of convergence is a strip parallel to the imaginary axis 
in the s-plane. 


As only the real part of s is responsible for the convergence of the Laplace 
transform, all points of the s-plane with the same real part have the same 
convergence properties. 


2. If x(t) is a right-sided signal, then the region of convergence lies to 
the right of a line through the rightmost singularity. 


In Example 4.3 we saw that for a right-sided signal with two singularities, the 
singularity with the greatest real part determines the region of convergence. 
The same is true for right-sided signals with any number of singularities. 


3. If x(t) is a left-sided signal, the region of convergence lies to the 
left of a line through the leftmost singularity. 


Comparing Examples 4.1 and 4.2 shows that for right-sided and left-sided 
signals, the region of convergence lies to the right or left of the singularities 
respectively. For multiple singularities. it is again the singularity with the 
ereatest real part that defines the region of convergence. 
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4. 


When 7(t) is bilateral — the sum of a right-sided and left-sided 
signal — the region of convergence is a strip between two singulari- 
ties, as long as the right-sided and left-sided regions of convergence 
overlap. 


The Laplace transform of a bilateral signal can (see (4.13)) be put together 
from its right-sided and left-sided components. The properties we have just 
discussed apply to the individual regions of convergence, and the complete 
region of convergence is their intersection. ‘This intersection is a strip that 
lies to the left of the rightmost singularity and to the right of the leftmost 
singularity. The intersection is empty unless all of the singularities in the 
right-sided component lie to the left of the singularities in the Jeft-sided 
component. 


In order to fully understand this, we re-examine Examples 4.4 and 4.5. In 
Example 4.4, the pole of the right-sided component (¢ = —2) lies to the left of 
the pole of the left-sided component (s = —-1), and the region of convergence 
is the strip between these poles. In Example 4.5, the pole of the right-sided 
component (s = --1) lies to the right of the pole of the left-sided component. 
(s = ~2) and the intersection is empty. so in this case the integral (4.13) 
does not converge. 


The region of convergence does not contain any singularities. 


Because of the properties we have discussed. it should be clear that the 
singularities of the Laplace transform either lie to the left of the region 
of convergence (singularities of the right-sided component) or to the right 
(singularities of the left-sided component). In the region of convergence 
itself, there cannot be any singularities. 


. If x(t) has a finite duration and if C{x(t)} converges for at least one 


value of s, then the region of convergence is the entire s-plane. 


If a(t) has finite duration. i.e., when :x(t) is only non-zero for A < t < B. then 
we can represent its Laplace transform by only the first integral ou the right- 
haud side, and we do not need to find any limits. All of the considerations 
concerning the region of convergence are then unnecessary, although a(t) can 
contain singularities itself, so that an integral over a(t) does not converge 
and in that case, the Laplace transform for «(t) therefore does not exist. 


. £{a(t)} can be analysed in the entire region of convergence. 


Within the region of convergence the derivative of Laplace tranforms can be 
formed corresponding to the complex frequency (4.14). We will discuss the 
differentiation theorem in the frequency-domain in Section 4.7.7. 
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4.6 Existence and Uniqueness of the Laplace 
Transform 


4.6.1 Existence of the Laplace Transform 


The previous considerations of convergence of the Laplace transform can be sim- 
ply summarised: the Laplace transform exists if the region of convergence is not 
empty. We have already discussed in detail how the region of convergence is de- 
fined from the right- and left-sided signal parts. Admittedly, however. finding all 
singularities is arduous with complicated signals, so we ask the question: is there 
an alternative to determining the existence of the Laplace transform directly from 
the time behaviour of x(t)? 

In order to answer this question we introduce the concept of exponential order. 
Ifa function is of exponential order, the Laplace integral CONVELEges. 


Definition 12: Functions of exponential order 


A funtion x(t) as of exponential order for t + 00, af, from a defined tame point 
L, wt grows alt most as fast as an exponential functron. 


lz(t)l< Me WET. (4.18) 


A function x(t) ws of exponential order for t + —o0, of 


lel <eMe™* Yis=T, (4.19) 


Mor functions x(t) that are integrable between any finite limits, we can already 
make assertions about the existence of their Laplace transforms. If x(t) is replaced 
by Me“ and Me”? in each Laplace transform, we can say from Exaimples 4.1 
and 4,2 in Section 4.4 that: 


® ifa right-sided function x(t) in accordance with (4.18) is of exponential order 
for t > 90, then £{2(t)} exists for Re{s} > C. 


® ifa left-sided function z(t) in accordance with (4.19) is of exponential order 
for t ~» —oc, then £{x{t)} exists for Refs} < D, 


These assertions for left-sided and right-sided functions can be put together for 
bilateral functions: 
If for a bilateral function x(t), 


1. ja(t)}| < MeP* fort < —T and 


2. |x(f)| < Me for t 


iv 


T 
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is 
3. f |z()\dt< M<c 


then £{r(t)} exists for C < Re{s} < D. 

As the estimates used are sufficient but not necessary conditions for the con- 
vergence of integrals, the existence conditions for Laplace transforms derived from 
them must also be sufficient but not necessary. This means that the region of 
convergence can be larger than the strip between C' and D. 


4.6.2 Uniqueness of the Inverse Laplace Transform 


With the examples in Section 4.4, we saw that functions of time can be uniquely 
expressed by their Laplace transforms, and likewise, the Laplace transforms each 
have a unique function of time, if the region of convergence is correctly taken 
into consideration. We are interested in knowing whether assigning a function of 
time to a Laplace transform is unique or does this representation of the function 
lose information that cannot be recovered by the inverse Laplace transform. The 
following theorem gives the answer. 


If the following conditions for two functions of time are true: 


1. f(t) and g(t) are made up of continuous sections 
2. f(t) and g(t) are of exponential order ¢ — oo and t —» —co 


3. the Laplace transforms F'(s) = C{f(t)} and G(s) = L{g(t)} exist 
and have overlapping regions of convergence in the s-plane 


4, F(s) = G(s) in the region of convergence 


then f(t) = g(t) everywhere where f(t) and g(t) are continuous. 

The proof of this theorem can be found [4, Chapter 6]. Instead of examining 
the details of the proof. we will consider two examples that clarify the conditions 
of the theorem. 


Example 4.7 


The function of time f(t) = ¢(4) and g(t) = —e(—t) fulfill both conditions 1 
and 2. For the Laplace transform, F'(s) = G(s), but with each different region of 
convergence, so that no overlapping occurs 


» Ref{s}>0 


fle &® | ee 


. Re{s} <0 
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This does not fulfill the second part of condition 3, and so we cannot say anything 
about whether f(t) and g(t) are equal. In fact, e(t) 4 —e(—1) for all t, even where 
both functions are continuous. ‘This example emphasises how important the region 
of convergence is. 


nnn example 4.8 
Figure 4.7 shows three functions that all fulfill conditions 1 and 2. They are 
only distinguished by their value at the discontinuity at t = 1, which is marked by 
a black dot. Only the middle function can be expressed by the step function (4.6) 
(e(t — 1)). Calculating the Laplace transforms of the three functions shows that 
conditions 38 and 4 are also fulfilled, and the theorem confirms the observation 
that all three functions are equal everywhere where they are continuous, that is 
fori < land ¢> 1. The theorem says nothing about the discontinuity at ¢ = 1, 
which would in fact be impossible, as the differences between each two functions 
for £< 1 andt> 1 are zero and the integrals over them also have the value zero. 


Figure 4,7: Example 2 of the uniqueness of the £ transform 


The previous example shows that the representation of a function of time by its 
Laplace transform does actually lose information: the information about function 
values at discontinuities. Admittedly though, discontinuous fictions of time are 
often only idealised versions of rapidly changing continuous signals. The step 
function <(t) is a good example as it represents an ideal switch operation, for which 
the assignment of a function value at the time of switching t = 0 is arbitrary. A 


qr 
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switch at t = 1 could be characterised just as well by one of the other signals 
in Figure 4.7. The loss of information about the amplitude at discontinuities is 
therefore insignificant for many practical applications. We can also summarise the 
uniqueness theorem this way: 


The assignment of a signal to a Laplace transform and vice 


For practical problems this property is sufficient. 


4.7 Properties of the Laplace Transform 


For the simple signals we have considered so far, evaluating the integral (4.1) has 
been the shortest way to find the Laplace transform. When dealing with compli- 
cated signals it is an advantage, however. to be able to use the properties of the 
Laplace transform. and avoiding having to evaluate the integral directly. Often 
it is also necessary to perform an operation on a time-domain signal (e.g. differ- 
entiation) in the frequency-domain. We will learn the most important properties 
of the Laplace transform in this section, and formulate theorems for them. The 
theorems will be needed in later calculations using the Laplace transform. 


4.7.1 Linearity of the Laplace Transform 


‘The Laplace transform is linear. so from the Laplace transform of a linear super- 
position of two functions of time, the Laplace transforms of these functions can be 
recovered. For any two complex constants a and 6: 


La: f(t) +b g(t} = a: L{ Fl} +b- {g(t} (4.20) 


_ for all values on the complex frequency plane. as long as both £{ f(t)} and L{g(t)} 
exist. The region of convergence for the combined function is the intersection of the 
regions of convergence for the individual functions. Singularities may be removed 
by the addition, however, so in general the combined region of convergence is a 
super set of the intersection between the individual regions of convergence: 


| ROC{af + bg} 2 ROC{{}N ROC{g} . | (4.21) 


1 


To show linearity, a- f(£) + b- g(t) is inserted into the definition of the Laplace 
transform (4.1). From the linearity of the integration, (4.20) is immediately ob- 
tained. 
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Example 4.9 


As an example we will evaluate the Laplace transform of x(t) = cosh(at) - <(t). 
This signal can be split into two exponential functions 


ey | 
x(t) = cosh(at) - e(¢) = a (ce + e7*) - (2), 
and now we can use the Laplace transform of each of the exponential functions. 


With (4.7), 


1 1 1 $ 
A(s)= ca ee soot ee ef{s)»a> : 
(s) 2 (; a 7 =) 2 a? Bish ee) 


The Laplace transform of the cosh function can be traced back without integration 
to the already known transformation of the exponential function. 


4.7.2 Shifting in the Time-Domain and Frequency-Domain 


Obtaining the Laplace transform of time signals that have been shifted in time 
or multiplied by an exponential function is simple. As these (wo cases are closely 
related, we will consider them together. 

If X(s) = L£{a(t)} is the Laplace transform of the time function x(t) and the 
region of convergence occupies s € ROC{x}, then the shaft theorem 


Ea —r)}=e 8 X(s). se ROC {a | (4.22) 


and the modulation theorem, 


Lie“*a(t)} = X(s~a), $s—Re{a}e€ ROC{z}, ae (4.23) . 
Ls cami : cn is Z 


apply. When multiplied by e®, the region of convergence is displaced by Re{a} 
to the right. Both theorems can be proven by the substitutions t = ¢’ — ¢ and 
s = s' — «a into the definition of the Laplace transform (4.1). 

Using the modulation theorem we can also clarify why the region of convergence 
of the Laplace transform has the form of a vertical strip in the s-plane. A vertical 
displacement in the s-plane corresponds to a multiplication of the time function by 
e* for a purely imaginary value of a. Since these factors have a modulus of one. 
the muliplication does not change the convergence of the Laplace integral (4.1). 
The region of convergence must therefore be a vertical strip. 
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4.7.3 Scaling of the Time Axis or Frequency Plane 

An expansion or compression of the time axis occurs, for example, if the unit of 
measurement of time is changed or if the speed of a magnetic tape changes. [rom 
the Laplace transform the original time signal X(s) = £{x(t)}.  s € ROC{x} 
becomes 


L{x(at)} = > X (-) . aX. (4.24) 


The region of convergence is scaled in the same way, ie. s € ROC{a(at)} if 
— € ROC{z(t)}. This relationship is shown through the substitution ¢ = at’ 
a 

into (4.1). 


4.7.4 Differentiation and Integration in the Time-Domain 


Tt is necessary, when dealing with differential equations, to know the Laplace 
transform of the derivation. and the integral of the time function. Construction 
of this relationship begins with the inverse Laplace transform in (4.2) 


If x(t) can be differentiated, we differentiate by t and obtain 


la (t 1 OTe ; 
A a = ony X(s)semds . (4.25) 
bie T— FOS 


We can take the differentzatzon theorem from this expression: 


{#20} <axj): se RoC 2 ROC{a). 


(4.26) 


Through integration of x(t) the integration theorem is obtained: 


fs 1 : 
£ {| o(e\de} a A(s),8 € ROC D ROC{xz} N{s:Re{s} > O}.) (4.27) 


The integration produces a pole at s = 0 that has an effect on the region of 
convergence. 

Although the differentiation theorem (4.26) is very simple and casy to remem- 
ber, in this form it is only valid for functions x(t) that can be differentiated for 
all t. Many important signal forms, like square wave or saw-tooth signals are ex- 
cluded by this condition. For this reason we will discuss some extensions of the 
differentiation rule that can also handle instantaneous signal changes. 
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Next we consider right-sided signals, that are only non-zero for t > 0, and that 
may have a step at ¢ = 0. This leads to the differentiation rule of the unilateral 
Laplace transform, that is important for the solution of the initial conditions 
problem (Chapter 7). Then we investigate signals that may have any number 
of steps. 


4.7.6 Differentiation Theorem and Integration Theorem 
for the Unilateral Laplace Transform 


Systems that are switched on at a specific time point (e.g. 1 = 0) have an output 
signal a(t) typically like that shown in Figure 4.8. 


Figure 4.8: Signal with and without step at ¢ = 0 


Before the turn-on point (t < 0), x(#) is zero and afterwards (t > 0), x(t) 
is any function that can be differentiated. For t = 0. the function can jump 
instantaneously and so x(t) as a whole cannot be differentiated, and the conditions 
for the use of the differentiation theorem in the form of (4.26) are not satisfied. 
In order to give a useable equation, however, we represent the right-sided signal 
x(t) by a bilateral signal u(t) which can be differentiated, and the step function 
é(t)(see Figure 4.8): 

a(t) = u(tje(t) . (4.28) 
In the following construction we use the signal u(t) in place of the signal z(t). This 


replacement is necessary for unique formulation of the differentiation theorem. 
The Laplace transform of x(t) (4.1) is 


X(s)= / a(t)e* dt = [woe dt . (4.29) 
00 0 


Partial integration of the second integral expression yiclds 


oO 


xX (es) = ee u(tj)e** - + : [ ie ae (4.30) 
8 ; 
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If x(t) and therefore also u(t) has exponential order for t + 00, then s € ROC{a} 
sX(s) = u(0)+ / w(tje~* dt . (4.31) 


i) 


Unfortunately we cannot simply replace a(t) with @(£), as the derivative of x(f) 
at t = 0 does not exist. To avoid this difficulty without using complicated mathe- 
matics, we introduce the function 


ea={ oO oa on ree = a(t) VtexO. (4.32) 


It is the same as the derivative of x(¢) where a(t) can be differentiated (¢ 4 0) 
and it is not defined at ¢ = 0. This hole in the defined region is not a problem, 
as we have already seen in Section 4.6.2 that deviances at isolated points do not, 
influence the value of the Laplace transform. 

It should also be noted that at t = 0 the value u(0) is equal to the right-sided 
limit of z(t) at t — 0. This value is also known as x(0+): 


u(0) = lim 2(0 +6) = 2(0+). oO (4.33) 


We have now obtained the differentiation theorem of the (bilateral) Laplace trans- 
form for right-sided signals: 


L{x°(t)} = sX(s) — (04). (4.34) 


It expresses the function «°(t) — which like (4.32) represents the derivative of x(t) 
- by the Laplace transform of a(t) and the (0+). 

For signals that are initially only defined for t > 0, the unilateral Laplace 
transform £,, which integrates only for positive time 0 < t < oo, is often used. 
For unilateral signals it is not distinguishable from the bilateral Laplace transform, 
and therefore has the same differentiation theorem (4.34). It is often given in the 


form: 
L£y{a(t)} = sX(s) — n(0) | (4.35) 


where it should be noted that the fumction «(t) and its derivative is only of interest 
for t > 0 and the value of (0) should be understood to be the right-hand side 
limit (4.33). 

The integration theorem of the unilateral Laplace transform matches the inte- 
gration theorem. for the unilateral Laplace transform (4.27) as a(t) does not have 
to be differentiable: 


- : a 
Ly {| v(c)ae} = £2G), s € ROCD ROC{x} ON {s: Re{s} > 0}. | (4.36) 
0 5 
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The unilateral Laplace transform is often used when dealing with initial value 
problems as its differentiation theorem explicitly takes into consideration the func- 
tion value at t = 0. We will continue using the bilateral Laplace transform. how- 
ever, and take into account the special properties of unilateral functions where 
appropriate (see (4.34)). 


4.7.6 Differentiation Theorem for Piecewise Continuous 
Signals 


The case of the unilateral function just considered is a special case of a piccewise 
continuous signal. The term ‘piecewise continuous’ means that the signal may 
have steps but inbetween it is differentiable. Figure 4.9 shows an cxample of such 
a signal with steps at times ¢;, tg. 3. The heights of the steps S(¢,) are positive 
for upward steps and negative for downward steps. We will restrict ourselves here 
to signals with a finite number of steps. 


Figure 4.9: Example of a piecewise continuous signal 


As in (4.28) we assemble the piecewise continuous signal x(t) from the differ- 
entiable functions u;(t), that each are switched ou at the time of the respective 
step. The heights S(t,) are equal to the values of the new functions u,(t,): 


a(t) = ug(t) + Ss ui(dett ~t,) and S(t,) = u(t). (4.37) 


a 


Using the Laplace transform and partial integration (4.29. 4.30) for all of the 
summed terms in (4.37) yields 


nr 


os Ton beg Be 
X(s)= : | ia + nut —t,)| eS dt - > S-uiltje ef . {4.38) 


as gaz] ty 


4.7. Properties of the Laplace Transform &l 


The expression in the square brackets of the first integral corresponds to the deriva- 
tive of x(t) where the signal is continuous (see (4.32)). that is. excluding the steps: 


ft 


xv°(t) = tig(t) + SS" ui(tle(t te) Se) teete ee detcatts (4.39) 


gee 
With the step heights $(t,) from (4.37). the Laplace transform of X(s) is finally, 


a 1 Th 
X(s) = ~£{2°(t) ses yogic: (4.40) 


gor] 


Rearranging yields the differentiation theorem for piecewise continuous signals: 


27 


£iae(t)t = 6 X(8)— yee tae (4.41) 


wl 


It contains the differentiation theorem (4.34) for unilateral functions with a step 
at ¢ = 0 as a special case. 


as nn  Hxampe 4.10 


We will now use the differentiation theorem for piecewise continuous sig- 
nals (4.41) to calculate the Laplace transform of a triangular impulse a(t) shown 
in Figure 4.10. 


x) 4 
] 
o—? ore 
a Oe 
-2T 27 t 
whl Onn 
(2TY 


Pigure 4,10: A triangular impulse and its derivative 


From (4.41) we obtain 
L{a°(t)} = 3 X(s) , (4.42) 
as the triangle impulse is not differentiable. but without steps. X(s) is the un- 


known Laplace transform of the triangle signal. The function x°(t), which contains 
the derivative of the differentiable region of a(t) is here the easiest to determine 
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and is shown in Figure 4.10, Instead of evaluating £ {x°(t)} using the Laplace 
integral (4.1) we use the differentiation theorem (4.41) a second time, and obtain 


OO fy) 9 1 28 2 1 —28T ‘ 
La (t)} =sl {x (t)t (oT)? ere? 4 QT QTy ee (4.43) 


As #°°(t) is zero at all points where it is defined, with (4.42) and some rearrange- 
ment, 


Ores 1 7) pty 2 d G 
0 = 8? X(s) — samy [°F — e7 8)" = 5? X(8) — 7 [sinh(sT)]? . (4.44) 


The Laplace transform of the triangle signal is therefore 


sinh(sT) 1° 
x(a) = |* | F 


Using the differentiation theorem for piecewise continuous signals (4.41). we 
avoided having to do any integration. 


(4.45) 


4.7.7 Differentiation in the Frequency-Domain 


The relationships for the Laplace transforms of differentiated functions of time 
that we have so far dealt with in detail, will be used in Chapter 6 to analyse LTT- 
systems in the frequency-domain. In the same way, relationships for the derivatives 
of Laplace transforms can be found. They are mainly useful for deriving transform 
pairs for frequently occurring functions. 

As‘a Laplace transform is analytic in its region of convergence. it can be differ- 
entiated any number of times. As in (4.25), we obtain with complex differentiation 
of X(s) from (4.1), 


atts) = | “alt) (—t) eat (4.46) 


and we can then obtain a theorem for the Laplace transform of functions of time 
z(t) that have been multiplied by the time variable t: 


dX(s) | 


L{tx(¢)} = -— 


sé ROC{z}. (4.47) 


4.8. Exercises 83 


Example 4.11 


As an example we will calculate the Laplace transform of x(t) = te~*’ -¢(t). 
We will be using the transform pair 
1 
Lie “ea)} = . Re{s} > —a. 


s+ a 


derived in Example 4.1. With (4.47) we obtain 


i 1 i 
fteMe(t)} = —< =e 4.48 
i ds E + -| (+a)? Sea 


Repeated use yields 


f au pat t) a __(n}! (4 49) 
{t e E(t }= (s+a)"} ' AY 


4.7.8 Table of the Most Important Laplace Transforms 


When dealing with simple LTI-systems it is sufficient Just to know some of the 
more frequently occurring transform pairs. The most important are summarised 
in Table 4.1, All of the pairs listed (and many more) can be derived from the 
relationships introduced in the previous sections. More comprehensive tables can 
be found in Appendix Appendix B.1, the relevant textbooks or in special collections 
of Laplace transforms [14]. When using such tables always take note of whether the 
unilateral or bilateral Laplace transform was specified. Most tables in textbooks 
give the unilateral Laplace transforms, but they can be used to find bilateral 
Laplace transforms if the function of time is completed by multiplying it with the 
step function e(t) (see Section 4.3). 


4.8 Exercises 


Exercise 4.1 


Calculate the Laplace transforms of the following signals using (4.1), as long as 
they exist. Determine the region of convergence for each, when you determine a. 
condition for s for which the improper integral converges. 


a) a(t) = sin(t) e(t) 
b) x(t) = sin(¢) 
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Table 4.1. Some important transform pairs for the Laplace transform 


x(t) | x (s) ROC | 
e(t) ; : Re{s} > 0 
en te(t) : 7 7 Re{s} > Re{-a} 
e“e(—t) a Re{s} < Re{—a} 
tem*elt) | aah ee een 
t"e “e(t) spar (s zi | Re{s} > Re{—a} 
(sin wot)e(t) ae Re{s} > 0 
(cos wt )e(t) | eae Re{s} > 0 


c) x(t) = e* e(t -T) 
d) x(t) = te e(t) 
e) x(t) = sinh(2t) ¢(-t) 


Check the regions of convergence with the properties given in Section 4.5.3 


Exercise 4.2 


Which of the following functions are of exponential order for | —+ 90? 
a)t? b)t5+20t4+7 c)e™ d)t?e% e)e”  f) sin(t). 


Exercise 4.3 


For which of the following functions can the bilateral Laplace transform exist? 
Check whether the functions are of Seponent tial order for t + 20 and t — —oo. 
a) sin(t) b)sin(t)e(t) c)t?  d) Se" 


Exercise 4.4 


Prove the linearity of the Laplace transform (4.20) using (4.1). 
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Exercise 4.5 
28+3 3s+1 


F(s) = ———— and G(s) = ————-—~ are the Laplace transforms of two 
(s) 52 +35 +2 ( ) Pe) “b 46 a8 [ 


right-sided signals. 
a) Find the poles of F'(s) and give the region of convergence. 
b) Find the poles of G(s) and give the region of convergence. 
c) Find the poles and zeros of F(s) + G(s) and give the region of convergence. 
Exercise 4.6 
Prove 
a) the shift theorem (4.22) 
b) the modulation theorem (4.23), 
by substituting (4.1) ¢=t/-— cands=s'—a. 
Exercise 4.7 
Prove equation (4.24) (time and frequency scaling) by substituting ¢ = at’ 
into (4.1). 
Exercise 4.8 
Derive the transform pairs in Table 4.1 starting with the transform pair 


L : 
é(t) o—e X(s) = - Re{s} > 0 using the theorems from Section 4.7. 
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5 Complex Analysis and the 
Inverse Laplace Transform 


In Chapter 4 we started with time functions and through evaluation of the integral 
definition in (4.1), verified the Laplace transform. For the reverse, the so-called 
anverse Laplace transform we gave the equation (4.2) without giving a justification. 
In this chapter we will look at the inverse transform in depth with the help of 
complex. function theory. We restrict ourselves to Laplace transforms that only 
have poles, and have no significant singularities. It will be shown that for these 
cases, carrying out the inverse Laplace transform leads to simple calculations that 
can be performed without having to continually refer back to function theory. The 
first step is to commit the important results from complex analysis to memory. 


5.1 Path Integrals in the Complex Plane 


We consider the complex function 


Q(s) = Q,(s) + 7Qi(s) (5.1) 


of the complex variable s. The real and imaginary parts of Q(s) are denoted by 
Q,(s) and Q;(s). 

In order to describe the integration of such a function it is not sufficient to give 
two limits of integration. As s may take any value in the complex plane, all of 
the values on the path between the start and end points must be given. Such an 
integral is written 


ye fas) ds, (5.2) 


where W is the path of integration in the complex plane. To define this path 
precisely, the values of s that lie on the path are given as a function of the real pa- 
rameters v. This is called a parameirie curve. Figure 5.1 shows such a parametric 
path of integration in the s-plane. For v = va, s(v) takes the complex value of 
the start point A, likewise for vy = vp s(v) takes the value of the endpoint B. For 
va <u < Vp, s(v) follows the desired path of integration W. The integral (5.2) 
means that the value of ((s)ds is accumulated from all of the infinitesimal elements 
ds on the length of the path W. 
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jo B 
V=V Pp 


V=VA ~-—____ infinitesimal element ds 
x of the path W 
A 


0 


W ={s:8(v) =o(v) + julv) Ava Sv <p} 
Figure 5.1: Path of integration in the s-plane 
For evaluation of the path integral not only is Q(s) represented by real and 
imaginary parts as in (5.1), but also s(v). 
s(v) =o(v) +ju(v). (5.3) 


Inserting (5.3) into equation (5.2), and using the substitution s = s(v) gives (after 
multiplying out and collecting terms) two real integrals with respect to the real 
parameter Vv: 


li 


/ as Sw (5.4) 


p= ficaor Sree (3) lav + if\e coe 40,9) dv . 


vA 


[vas 


Ww 


The path integral in the complex plane (5.2) is actually only a compact form of 
the lengthy expression in (5.4). As (5.2) can be viewed as a sum of many real 
value integrals, the known rule for real integrals is also valid for the path integral 
in the complex plane. 


5.2 The Main Principle of Complex Analysis 


If Q(s) is analytic (i.e. free of singularities) in a region G then the integral 


[ atens- [ Qle)as = [aeras (5.5) 
“A 


Wy We 
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is independent from the path, as long as both paths W, and W 2 run completely 
within G and there are no singularities between them. Figure 5.2 shows two paths 
of integration that produce the same value when integrated. An important result is 


Figure 5.2: Independent path integrals Wy and W. 


obtained if the integration stretches from A to B along the path Wy and then along 
the path W, against the direction of arrow back to A. Such an integral around a 
closed path is called a circular integral and is denoted by an integral sign with a 
circle. If-the integration along Wy, and W> produces the same value. the circular 
integral along W, in the direction of the arrow and W 2 against the direction of 
the arrow must give the value zero. This statement is valid for any paths Wy and 
W. as long as they are inside G. The main principle of complex analysis follows 
directly from this: every circular integral inside the region G disappears if the 
path of integration does not include any singularities: 


J A) ds =0. (5.6) 


5.3 Circular Integrals that Enclose Singularities 


The previous statement refers to paths of integration that do not enclose singular- 
ities. For the characterisation of complex functions, however, the singularities are 
important. We therefore also need relationships for circular integrals that contain 
singularities. 

Next we clarify whether the value of a circular integral containing a singularity 
depends on the route of the path of integration. We consider Figure 5.3 which 
shows two different closed paths of integration W , and W 2 within the analytic 
region G. Both enclose a singularity that lies within the white region in the middle 
which does not belong to G. For the calculation of the difference between the two 
circular integrals along W, and W2 we can refer back to the calculation of two 
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circular integrals without a singularity. In place of the calculation of the integrals 
along W; and Ws we go from W to W2, and then back again along W,. The new 
circular integral along W,, does not contain the singularity. The same procedure 
is repeated for the untraversed parts of Wy and W2 and the path of integration 
Wg is obtained. If the transition from W , to W2 and vice versa, is chosen so that 
the contributions to W, and Wz, cancel due to the opposite orientation, then the 
integration along W, and W, equals the difference of the integrals along Wy and 
W 2. As neither Wa nor Wg encloses a singularity, both integrals are zero and 
therefore the integrals along W, and W, have equal value. 


Q(s) ds — Q(s) ds = f Q(s)ds+ (s)ds=0. (5.7) 
IWeo 


JW 


Wy Wo 


0 


Figure 5,3: Equal value integrals around a singularity 


This argument can be used for any two ring integrals around a singularity in 
G. The value of the integral does not depend on the form of the path containing 
the singular inner region. 

If a closed path of integration W contains multiple singularities (see Figure 5.4) 
we can show in the same way that the circular integral along W is the samc as 
the sum of the circular integrals around the individual singularities (W1, W2 and 
Ws in Figure 5.4). 

In a multiset connected analytic G, the value of a circular integral only depends 
on which singularities are enclosed by the path of integration 


N 


‘a Q(s) ds = y f, Q(s)ds. (5.8) 


The value of the circular integral around an individual singularity. independent 
from the path of integration W,,, can also be expressed by the corresponding 
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residuum: 
‘ks 
27 


Ry = f. Qs) ds. (5.9) 


The equation 


N 
} Q(s) ds = 27 S> Ry (5.10) 


JW b= 4: 


is called the residue theorem. We will show how to calculate residucs in the next 
section. 


analytic 
region G 


Figure 5.4: Regular area with multiple singularities 


5.4 Cauchy Integrals 


Now that integration around multiple singularities has been reduced to calculating 
circular integrals around individual singularities, it still remains to be determined 
what value an integral around an individual singularity has. That is equivalent to 
calculating the residues in (5.9). To this end we consider a singularly connected 
analytic region G of a complex function F(s) according to section 5.2 


f F(s)\ds=0 VWCG. (5.11) 
JW 


The function 
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is then formed, which has a simple pole at. s = so. For the circular integral of Q(s) 
around the pole sg (see Fig. 5.5), the Cauchy integral is 


f Q(s)ds = } He) ds = 2nj F(sq)- (5.13) 
JW Jw 3 


— 89 


Figure 5.5: Singularity so in the regular area G 


The Cauchy integral can easily be proven by integration of an infinitesimal 
circle around so, that is parametricised. for example, by s(v) = beJ**" 4. so. For 
any small radius 6, along this path: F'(s) = F (so). 


5.4.1 Residue Calculation 


With the Cauchy integral we can easily give the values of the residues (5.9). For 
a simple pole of Q(s) at s,,, 


1 ; ore 
EG, Q(s) ds = F(s,). (5.14) 
J IW, 
Although it is not necessary, the residues can be found using complex integration. 
Tf only Q(s) is known, the residuum #,, at s, (5.12) can also be found using the 
limit: 


R, = lim [Q(s)(s — s,)}. (5.15) 


The calculation of a circular integral for a complex function with many simple 
poles can be done using the residue theorem (5.10) and (5.15), This technique is 
particularly appropriate when Q(s) is a rational fraction function. 

Calculation of the residues has so far only been shown for simple poles. To 
calculate multiple pole residues, we need some further results from the Cauchy 
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integral. We now write it in the form. 


F(s)= : DD iy 


= —— (5.16) 
204 Jy Wo s 


It can be shown that regularity (i.e. being analytic) of the complex derivatives of 
F(s) entails regularity of F'(s) itself. Then 


‘Ss l "Fae ' d FE 
Fs) = oe) ie ¢ wo) dw = : p aE) dw = 


ds ds2rj Jy w—s 207 Jw dsw—s 


\ -  F(w 
=> } ae = dw. 
2m Jw (w — 8)? 


Interchanging integration and derivation with respect to s is permitted as the 
integral converges uniformly. Deriving (n — 1)-times with respect to s gives 


(5.17) 


7 din-1) (n—-1)! E(w) noe 
gin —l) s\= s\)= _ 3 3 ds . 5.18 
F (8) = say F(s) Tah fo Ca (5.18) 
With the function 
Qn(s) = (6.19) 
TEAS, (s = 80)” 


and the correspondingly altered notation in (5.18), we obtain a formula for multiple 
poles that is equivalent to (5.13) 


f Qn(s) ds = f mes ds = 207 
Jw 


c FON (50) , (5.20) 
J (8 — 80)” : 


ae ae 
(n~-1) 
The residuum at the location of the n-order pole s, of Q (8) 


p 2 Td Wy, 


is again obtained without complex integration, from (5.19) 


1 grt | ; 
See Tin, fo, OS BN: 2 
Se (n— 1)! ae Ee lQn(s)(s~ 84) ] of) 


5.4.2 Integration Parallel to the Imaginary Axis 


The last section showed that the Cauchy integral significantly simplified the eval- 
uation of circular integrals around single and multiple poles, using the residue 
theorem. In this section we will discuss another simplification that leads to a form 
of the inverse Laplace transform. It can be used not only for poles, but also for 
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essential singularities, but first we have to make some restrictions. We consider an 
analytic function F'(s) within a region, that decays by at least 1/|s| for sufficiently 
large values of |s| 


M ‘ 
(s)| oe (5.23) 
[s| 
M is any positive real number. Then 
F(s) M 
el ee 5.24 
8— 8% |s|? (2) 


with the positive real number M. To use this decrease for large values of |s| we 
choose the circular integral around sy as in Fig. 5.6. The analytic region contains 
all values of s where Re{s} > oy)j,- The path of integration consists of the path 
W>. which runs parallel to the imaginary axis at a distance op > Oyjy, and the 
path W,., which is an are with radius R around the origin 
=n ; F(s) ' F(s F(s es 
2njF (sq) = f ds = Ban ) ds + ee: (5.25) 
W,+W, S— 8g 8 SO ‘ &— SQ 
Wp W,. 


We estimate the integral over W,. with (5.24) 


J (0) 
I a Ay L 
’ rae ‘fy 
GY YY 
A f Lee, “i, 
ae : 


Figure 5.6: Path of integration with curve segment W, parallel to the imaginary axis 
F(s) 


J ie I), s/f ds| <M / 
S— 80 8 SO 
Ww W, 


ys r 


ds\ . (5.26) 


1 
(sP 
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The last integral can be parametricised with s(v) = Re’”, and we then obtain 


n/2 ial ) n/2 ‘ 
1 io. of 1 ds(v : ae eh 
wom CEST == IV cies a M : R Oa ee: ae csi 
arf isp M | ae | do d } Fa Re dy 7 
- —n/2 1 /2 
(8.27) 


For R — oo the value of this integral approaches zero, so that in (5.25), only the 
integral via the path W, remains: 


Tp-Joo \ Tyr P 
7 1 F(s 1 : "(sg ; 
F (sg) = —— i (8) ds = —— | (s) ds with Re{so} > op. 
any J 8 = 8g 2m 89-8 
Opty Fpm ye 


(5.28) 
Thus under the condition (5.23) the circular integral is calculated by integration 
parallel to the imaginary axis. 


5.4.3 Importance of the Cauchy Integral 


If an analytic function f(s) is known along a closed path W, and J'(s) is analytic 
everywhere in the enclosed region (Fig. 5.5), the Cauchy integral (5.16) can be 
used to calculate F'(s) everywhere in the enclosed region. The pole in (5.16) is 
moved to a location of interest. It is therefore completely sufficient to know F(s) 
on the border of an analytic region. It is likewise sufficient to know F(s) along 
a line parallel to the imaginary axis (5.28), to be able to calculate every value 
to the right of the line. Because it is differentiable, an analytic function has a 
strong inner structure, In fact, F'(s) can even be analytically continued outside of 
a closed path W, and also when F'(s) is only known along a section of the path. 

Now that we have found the Cauchy integral. the review of complex analysis is 
concluded. We will now use the result to derive the formula for the inverse Laplace 
transform and give simple ways to perform it. In this respect, the Cauchy integral 
is important for two reasons: 


@ The simplification of the path of integration considered in section 5.4.2 leads 
directly to the formula for the inverse Laplace transform. 


e@ The residue theorem (section 5.4.1) allows a simplified calculation of the 


inverse transform (without complex integration) for systems with single or 
multiple poles. 


5.5 Inverse Laplace Transform 


To derive the inverse Laplace transform we start with the Cauchy integral in 
the form of (5.28). The condition (5.23) is always fulfilled by a rational fraction 
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Laplace transform, if the numerator is of a higher degree than the denominator, 
Otherwise the inverse transform leads to distributions in the time-domain that will 
be introduced in Chapter 8. We will begin with the derivation for the unilateral 
Laplace transform and then extend the result to the bilateral Laplace transform. 


5.5.1 Inverse Unilateral Laplace Transform 


To derive the inverse unilateral Laplace transform we use the Cauchy integral for 
a path of integration parallel to the imaginary axis (5.28), where we rename 8 as 
s' and so as s 


a+poo 
1 "  F(s') , 
F(s\)=-—— 4 rit e415 : 5.29 
(s) Oni | aa ds’ with Re{s} >o (5.29) 
Om IS 


We continue using the Laplace transform of a unilateral exponential function (com- 
pare Example 4.1) 


Le e(t)} = Lyfe*"} = | ef te dt = 
0 
Putting (5.30) into (5.29) yields 


1 


s-s! 


. Refs} > Ref{s’}. (5.30) 


‘ o 


F(s) = = | F(s') ete sta ds’ 


= flag | F(s')e®' ds'| e~* dt (5.31) 


by swapping the integrals under the condition that the convergence is of the same 
type. Comparison with the unilateral Laplace transform in (4.5) 


oC 


0 


shows that F'(s) is the Laplace transform of the time function inside the square 
brackets in (5.31). Consequently, the bracketed expression represents the inverse 
unilateral Laplace transform: 

O-byoo 


fi)= i F(s)e*'ds. (5.32) 
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5.5.2 Inverse Bilateral Laplace Transform 


The inverse bilateral Laplace transform can be formed by combining the inverse 
transform already obtained for right-sided signals and the corresponding inverse 
transform for left-sided signals (see Example 4.2). The derivation for left-sided 
signals is carried out as in (5.29) to (5.32), so that we can avoid repeating steps. 
The two steps are distinguished from each other by the direction of integration of 
the Cauchy integral, and the sign of the left-sided function. 

As the region of convergence for left-sided time functions lies left of a vertical 
line in the s-plane (see Fig. 4.4), the circular integral must also be contained within 
the left half of the s-plane. Since. by definition, the positive orientation of complex 
contour integrals is counter-clockwise, the parallel to the imaginary axis has to be 
traversed in the opposite direction to (5.29). This leads to a change of the sign 
compared to (5.29) for the Laplace transform of left-sided exponential functions 


0 
z Pp ah a 1 = 
L{-<(-t)e® = —- fe te dt = ——— =, (5.33) 
ax 


s—s 


This is the same in Examples 4.1 and 4.2. where a left-sided and a right-sided 
function of time have the same form of Laplace transform. Note that here there 
is a minus sign in front of the left-sided exponential function. 

Putting (5.33) into the Cauchy integral for left-sided signals compensates for 
both changes of sign and we likewise obtain for the inverse transform equa- 
tion (5.32). This shows that the inverse of right-sided and bilateral Laplace 
transforms have the same form. The region of convergence should be considered, 
however, for the bilateral Laplace transform . 

A bilateral signal can be split into left-sided and right-sided components, so 
the inverse bilateral Laplace transform can be expressed as 


TH+HIOO 
; L ; 
f(t) = LOL F(s)} = ny | F(s)e* ds . (5.34) 
o-oo 


5.5.3 Path of Integration for the Inverse Laplace Transform 


The choice of the path of integration W, in Fig. 5.6 is appropriate because it 
can be easily parametricised, but alternative choices would also be possible. Also, 
every other path of integration within the region of convergence of F(s) gives the 
same result, since F'(s)e*' is analytic. Fig. 5.7 shows several permitted paths of 
integration. The multiple possiblities are only useful when the complex integration 
is actually carried out by parametrisation. In most cases it is simpler to use the 
residue theorem. 
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Figure 5.7: Various paths of integration for an inverse Laplace transform 


5.5.4 Calculating the Inverse Laplace Transform with the 
Residue Theorem 


Calculating the inverse transform is simplest with the residue theorem. It reduces 
the calculation effort to partial fraction expansion, which will be discussed later. 

On first glance, it seems impossible to carry out the inverse Laplace transform 
with the residue theorem. To use the residue theorem, a path of integration must 
be chosen (see Section 5.3) for which the function is analytic and the singularities 
are enclosed. On the other hand, we know from Chapter 4.5.3. that the Laplace 
transform is only defined within its region of convergence, which is a strip on the 
complex plane that contains no singularities. A path of integration that encloses 
all singularities must therefore run outside the region of convergence, where the 
Laplace integral diverges. 

To solve this conflict, we use the method of analytec continuation, which is 
related to the discussion in Section 5.4.3. We will explain this method with Exam- 
ple 4.1. where we will calculate the Laplace transform of a unilateral exponential 
function f(t) = e~*te(t). The result is (4.7) 


F(s) = £Ef()} = Lte(te*) = = Refs} > =a. 


Outside of the region of convergence (for Re{s} < —a) the Laplace transform does 
not exist. The function 


A(s) = — (5.35) 
s+a 
is analytic in the entire complex plane, except for the points s = —~a@. Within the 
region of convergence of F(s). 
F(s) = A(s); Refs} > —-a. (5.36) 


In contrast to F(s), il is possible to choose a closed path of integration with a 
field of regularity that encloses the pole s = —a (compare Fig. 5.4). The value 
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of this integral can be calculated using the residue theorem. A(s) is known as 
the analyte contenuation of F(s). In the same way, every other rational fraction 
Laplace transform can also be assigned an analytic continuation, The difficulties 
encountered when using the residue theorem have now been removed, as we can 
now calculate the residues using analytic continuation. In terms of the actual 
calculation, the switch to analytic continuation makes no difference as it has the 
same form as the Laplace transform. 

We will limit ourselves to right-sided functions at first, for the sake of simplicity. 
These functions have, of course, a Laplace transform with a right-sided region of 
convergence. so all the singularities lie left of the path of integration for the inverse 
Laplace transform (5.34). By combining (5.34) with the residue theorem (5.10), 
we obtain 


{ ee N 
f= LUPO = 5s f Fleet ds= > Ry. (5.37) 
at, am a 
FH 9XS 


The path of integration is completed from s = 0 — joo to 6 = a+ joo by a very 
large (approaching infinitely large) arc through the left half of the s-plane. If 
F(s)e* decays more quickly than - with growing radius R, the contribution of 
the arc to the integral disappears. so its value is not changed by closing the path of 
integration. For a closed path of integration, however, the residue theorem (5.10) 
can be used, and (5.37) can be immediately obtained. For a rational fraction F(s), 
for which the denominator is greater than the numerator. (5.37) is valid for t > 0. 
if F(s) contains exponential terms, for example, the disappearance of the arc’s 
contribution to the integral dependent on ¢ must be investigated separately. 

For bilateral functions of time we have to complete the path of integration 
with a second arc through the right half of the s-plane. which then encloses the 
singularities to the right of the region of convergence. The sum of the residues 
of F'(s)e* in accordance with (5.37) then yields for a rational fraction F'(s). the 
time function f(t) for t < 0, because the contribution of the are to the integral for 
Re{s} > 0 only disappears when t < 0. Using the observations in Section 5.4.1. 
the residues can be obtained by integrating the analytic continuation of F(s)e** 
on a path around all poles. For simple poles the residues R,, of F(s)e*! (5.15) are 


R, = lim [F(s)e*"(s = 82)| = Pern! . (5.38) 


SS, 


These can also be expressed by the residues P,, of F(s) 


Py = ee [F(s)(s ~ 5,)| (5.39) 
as e* is analytic in the entire complex plane. Calculation of the inverse Laplace 
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transform for a rational fraction /’(s) with simple poles is then reduced to 


Nt 
f(t) = LF (s)} = >> Pretrte(e) +S Premtel aH). (5.40) 
p= pol 


Here, pt are the residues (5.39) of F(s) for poles left of the region of conver- 
gence and Py are the residues for poles right of the region of convergence. The 
summation covers all N+ to N~ poles. 
The same result is obtained for a rational fraction function '(s). when we write 
F(s) as a partial fraction expansion 
N 


F(s)=5~ ae (5.41) 


oo Su 


pool : 
Piece-by-piece inverse transforming, while bearing in mind the location of the 
poles relative to the region of convergence leads exactly to (5.40). Of course. this 
is not a coincidence because (5.39) is the formula for calculating partial fraction 
coefficients for simple poles. There are also other methods available for calculating 
partial fraction coefficients, for example. equating coefficients. 
For multiple poles. the residues R,, of F(s)e** are obtained from (5.22) 


1 j . 
= li atanaerr ect 5 St So m ‘ Oe 
fi ae J” ( 


ot 

i 

ho 
_— 


The use of this formula is demonstrated in an example. 
= Example 5.1 


The Laplace transform 


1 : , 
F(s) = --—-———— . Refs} > 1 5.43 
@) (s-+ I)(s 4+ 2)? a) oe) 
has a simple pole at s; = —1 and a double pole at s2 = —2. The inverse transform 
requires that the residues are calculated at both these points: 
f@)=L°{F(s)} = Ri + Re (5.44) 
with 
~st 
1 = F(s)e(s+1 gee) “eae 5.45 
Ry Flsyer'(a +t 1)|. 2. (s+ 22 |,__; ( ) 
1 d r spf 9 d est | 
2 = oe (le (9 + 2)" = : 
Re page ee wa. as i(s+t)| |, 
st ot 
= s+- be a met. te 2 (5.46) 
(s +1)? (s+1) gee) 
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From the two residues the function of time can now be put together. As F(s) is in 
rational fraction form and converges in the right half-plane, the inverse transform 
leads to a right-sided function of time: 


f(t) = £7 '{F(s)} = [et — eo! — te] c(t). (5.47) 


A relationship to the partial fraction expansion can be constructed here too 
for multiple poles. An example of this is given in the next section. 


5.5.5 Practical Calculation of the Inverse Laplace Trans- 
form 


Using the residue theorem avoids evaluation of complex integrals, but for complex 
poles, it requires calculation of complex residues. For rational fraction Laplace 
transforms with real numerator and denominator coefficients, the corresponding 
function of time is likewise real, even when complex poles appear (here in complex 
conjugate form). It would therefore be convenient if the inverse transform could be 
carried out purely with real calculations. This can be done using an appropriate 
combination of partial fraction expansions and the modulation theorem. We will 
show the procedure in an example. 


Example 5.2 
We want to find the inverse Laplace transform of 
222 


He) = Ga a\e2 de or 


Re{s} > 0. (5.48) 
We can see from the region of convergence that we are dealing with a right-sided 
function of time. Starting with the partial fraction expansion 


: 222 A Bs + 
F(s) " Were Wire (5.49) 


and with (5.15), we obtain 


222 222 _ 222 | 


A= lim [F(s)(s+3)] = ————"-—]|s = ee HG. O55 
jimlF(s\e+3)l = sae ag 7 Se ar 2 OD) 


-3 
As the other poles of F(s) are complex. we determine B and C by equating 
coetficients, to avoid having to calculate complex residues. From 

6(s* +48 +40) +(Bs+C)(s+3) = (64 B)s? 4 (2443B4C)s4+ (240+ 8C) = 222 
(5.51) 
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we obtain B= C = —6, 

We can expect that for a second-order denominator with real coefficients and 
complex conjugate poles, that the corresponding function of time is composed of 
sin and cos terms. We therefore want to bring the second term of the partial 
fraction expansion (5.49) into a form that corresponds to sine and cosine functions 
of time. This can be done by completing the square 


Bete... -sbse6 -«. s6lepe)-26 (5.52) 
s?+4s+40  s2+48+40  (s+2)2436° ve 
Putting this into (5.49) gives the representation 
6 . s+2 6 
F(s) = ae lee ne (5.53) 


“st+3 (st22+62 | (+22 +6. 
With Table 4.) and the modulation theorem (4.23) we obtain the function of time 


f(t) = 6e~** . e(t) — 6e~** cos 6t - e(t) + e~* sin Bt - E(t). (5.54) 
Se ae i 


Partial fraction expansions are also advantageous for multiple poles. They 
avoid multiple derivations with respect to s when calculating the residues (5.42). 
but the partial fraction coefficients have to be calculated instead. ‘To compare the 
two possibilities we will consider the function from Example 5.1 once more. 


- Example 5.3 
The partial fraction expansion of the function F(s) from Example 5.1 needs 
three coefficients: 


B, Be 


1 A 
F(s) = —————> = — tH OO Ht OO - 5.55 
(s) (s+1)(6+2)? s+1 8+2 (s+2)? (2-58) 
For simple poles the coefficients can be calculated (5.39): 
A= lim [F'(s) (s+i)J=1. (5.56) 
aaa 
To understand how B, and By are determined, we consider the term 
s+1 s+ 
‘(s)(s+1) = A+ B,;—— + B,-—— 5.57 
ca tee ae PE aa NET (5.57) 
again. Substituting s = —1 gives the exact value of A because the other two terms 
become zero. This procedure also works for Bo, so 
a 4st 7 a 
F(s) (s + 2)* = A——— + By(s + 2) + By (5.58) 


s+] 
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and setting s = —2 yields 
By = lim |F(s) (s+ fee mee (5.59) 
i ae oma} 


We obtain B, in the same way if we form 


d d [ (s+2)? is d [(s+2)? 
(s oA By SAS |e ea 
gO) (+2) = ds e eal Pe eye ee ds | s+1 : 
(5.60) 
and put in s = —2: 
B, = lim 4 i p(6) ($+2)?] =—-1 (5.61) 
eer se aa : ; 
The partial fraction expansion of F(s) is then 
1 1 1 1 

F(s) = = = 2 . (5.62) 


(stij(s+2)? s+il 8s+2 (s+2)? 


Inverse transforming term-by-term, for example. using Table 4.1 gives the same 
result that we obtained in Example 5.1 with the residue calculation. as long as we 
bear in mind the region of convergence: 


f@)=L°MUF(s)} = [ew Peng t= te~**] e(t). (5.63) 


The principle used in the previous Example 5.3 can be extended to cover order 
m poles. Partial fraction coefficients By,...B,, are then found with 


1 qt ~ fb 


Ses Jima rer F(s) (s — 8)" B=l...m. (5.64) 


5.6 Exercises 


Exercise 5.1 


Find the Cauchy integral (5.13) by integrating an infinitesimal circle around so, 
which should be parametricised by s(v) = s9 +d e??"", 0<v <1, where 6 can be 
any small real number. 


Exercise 5.2 
Find the inverse Laplace transform f(t) = £7'{F(s)} of 


2—28 
- Ss aN Cae Ove OR BA & > 
(s) (s+ 1)(s+2)(s +5) Re{s} : 
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Exercise 5.3 


Find the inverse Laplace transform f(t) = £7!{F(s)} of 
25 — | 
F(s) = eaiNet a’ Re{s} > —1. Compare different methods of partial 


fraction expansion. 
a} Calculate all partial fraction coefficients with (5.64). 


b) Calculate the partial fraction coefficients of (s + 4) and (s + 1)° with (5.64) 
or (5.39) and the others by equating coefficients. 


c) Calculate all four partial fraction coefficients by equating coefficients. 


Exercise 5.4 


b5+3 ; ’ : . ‘ 
F(s) = —+——~——— has complex conjugate poles and a right-sided region of 
si +25 +5 


the result as sine and cosine terms. 
A A* 


a) Use the complex partial fraction expansion F'(s) = ———~ + -——; 
S~-8§ S—- 8S 
; i 


b) Complete the square, then use the shift theorem and ‘Table 4.1. 


Exercise 5.5 
Find the inverse Laplace transform f(t) = £7'{F(s)} of 


‘ Ss 
F(s) = ax 
) = Cea Ta) 


Re{s} > 0 using partial fraction expansion with real 


values. 


Exercise 5.6 
Find the inverse Laplace transform of 
2 ‘ 
ses —2 os 
F(s)=—- ————- Refs} > 1. 
(s) (s° +452 + 8 —6)- 8?’ 


Exercise 5.7 


383 — 1257 — 165 —5 
st +753 +179? +178 +6 
Determine the inverse Laplace transform f(t) = £7'{F(s)}. (Note that there is a 
double pole at —1.) 


Let F(s) = Re{s} > —1. 


6 Analysis of Continuous-Time 
LTI-Systems with the Laplace 
Transform 


The Laplace transform introduced in Chapter 4 does not only serve to charac- 
terise signals; above all it provides an elegant description of the properties of 
LTI-systems. In system and network theory, it is the standard method for deriv- 
ing the system response. In particular, given initial values of the output signal 
and initial states of systems can be considered using it. 

We are now concerned with the derivation of the system response to bilateral 
signals and with this we can determine the transfer (or system) function. At the 
end of the chapter we will extend the results to cover combinations of LT I-systems. 
The solution of initial value problems will then be dealt. with in Chapter 7. 


6.1 System Response to Bilateral Input Signals 


In this section, we consider the response of LT I-systems to input signals. on which 
we make no restrictions, except that their Laplace transforms must exist. In 
particular, bilateral signals are also permitted. 

Next we recall the definition of the Laplace transform from Chapter 4.2. where 
we had interpreted it as the analysis of a function in exponential terms, and 
its inverse as the recombining of these terms. Now we put a further operation 
in between these two steps, that we have already encountered in Chapter 3.2.2: 
determining the response of an LT1-system from its eigenfunctions. With this, the 
three stage system analysis that we outlined in Chapter 3 is complete: 


1. Analysis of the input signal in exponential terms can now be accomplished 
with the Laplace transform. 


2. Determining the system response from the individual terms, with help from 
the system function. 


3. Combining the individual components at the system output to form the 
complete output signal is achieved with the inverse Laplace transform. 
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‘To mathematically formulate the system analysis we look back to the inverse 
Laplace transform, expressed as a Riemann sui (4.4). For output signal y(t). 


1 . LV sot r ayt a Sot 3 
y(t) = ee Jim {on + ¥ (sere! + (sie! + ¥ (sole! +... $ As. (6.1) 
The individual terms of the summation arc single complex exponential functions, 
and so also eigenfunctions of the LTI-system. As in Chapter 3.2, we can express 
this by multiplication of the exponential terms X(s,)e%* of the input signal x(t) 
(see (4.4)) with the system function H(s) (see Figure 6.1) 


Y(s,Je°" = H(s)X (s,)e** (6.2) 
and thus obtain the output signal 
1 mf 7 \24 $8 
y(t) = Oni Jim, {... + A(so)X (soe! + H(s1)X(sy)e** (6.3) 


+ H(s2)X(so)e** +...) As. 


X(t} y(t) 
X(s,)e*! H(s,)X (s,)e%* 


Figure 6.1: Eigenfunctions of an LTI-system 


Instead of the Riemann sum we now write the corresponding complex integral 


1 T+ ; ; ; L te 
oy H(s)X(s)e**ds = | 


Y(s)e"ds. 1.4 
oa 3a (s)e*ds (6.4) 


7 OS O-PS 
From this follows the fundamental relationship between the input and output 
signals of LT l-systems (see Figure 6.2) 


YO) = H(s)X(s) | (6.5) 


H(s) is the system function or transfer function, that we already know [rom 
Chapter 3.2, In contrast to Chapter 3.2, however, it is not now only defined as 
the ratio of exponential oscillations, but also more generally as the ratio of the 
Laplace transforms of the input and output signals. The system function is the 
key to finding the system response. because it represents a complete description of 
an LTI-system. There are two fundamental ways of finding the system function: 


i. Forming the quotient of Y(s) and X(s). if the input and output signals are 
known. 
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2. Analysing the system, if its internal structure is known. 


The first. possiblity is a case of system identefication, the second is system analysis. 
Using some simple networks, we will show the procedure for system analysis. 


a(t) —~} fs) ” y(t) 
9 9 
X(s) Y¥(s) = H(s)X(s) 


Figure 6.2: Determining the system response with the system (or transfer) function 


6.2 Finding the System Function 


We will now demonstrate how to find a system function, using two electrical net- 
works as examples. In Chapter 3.2.5 we learnt two ways of avoiding physical 
dimensions. We will perform both of these methods here —- in Examples 6.1 
to 6.5 we will work with normalised equations, and in Examples 7.1 to 7.5 in the 
next chapter, we will demonstrate the procedure with physical units. 


~ —~ Example 6.1 
The first network we will consider is the RC-circuit depicted in Figure 6.3. ‘The 
components have already been normalised so that they have helpful values. 


C=0.01 
ral 


u(t) = E(t) 


Figure 6.3: RC-circut 


Analysis of this network can be carried out directly in the frequency-domain, if 
the components are given their complex impedances (from Table 3.2), The system 
function is immediately obtained if the Laplace transform of the output signal is 
divided by the Laplace transform of the input signal: 


Us(s) R 8 
if jJ)=— - ~ = ee 
Cae: () ppt s+i0 
sC 


(6.6) 


108 6. Analysis of Continuous-Time LTI-Systems with the Laplace Transform 


With a known input signal, the Laplace transform of the output signal follows 
immediately with (6.5) as Uj(s) = H(s)U\(s). For a step function ¢(t) at the 
input we obtain (compare Table 4.1) 


1 1 
lo(s) = H(s)- = » Re{s} > —10 @---0 ug(t) =e !e(t). (6.7 
(8) = H(s)= = a. Refs} 2(t) (‘). (6.7) 
The input output relationships in the time-domain and the frequency-domain are 
shown in Figure 6.4. The response to the step function ¢(t) is called the step 
response. Vigure 6.5 shows the step response for the RC-circuit. 


Re s > ) s S)=- 
, Re{s} > Ui (s)A(s) oa) 


4 1 


Figure 6.4: System function and system response for the RO-circuit 


0.1 


™ 


Figure 6.5: Step function and step response for the RC-circuit 


As the input signal is explicitly left as a bilateral signal, the output signal it 
defines contains the entire past history of the system since t = —oo. for every point 


in time. Additional knowledge of initial conditions or states of energy stores at 
certain times is not required. 


Example 6.2 


We consider for the second network, two independent RC-circuits as shown in 
Figure 6.6. As the voltage u(t) is coupled to the right part of the circuit by the 
voltage source, the system function is 


Us(s) _ Us(s) Ua(s 
( 


H(s) = =~ . 


Ui(s)  Ua(s)  Uy(s) (6.8) 
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C= 0.0] C= 0.01 


uy(t) = e(f) u(t) R= 10 u(t) R=10 u3(t) =? 


<0) 


Figure 6.6: Independent RC-circuits 


» 


uy(t) = e(t) ———» eco} u3(t) = (1 — 10t)e7'*e(£) 
i i 
1 8 
ie) U,(s)H(s) = Gripe 


Figure 6.7: System function and system response of the independent RC-circuits from 
Figure 6.6 


Driving the circuit with a step function gives a transform of the output signal 
similar to (6.7). A simple partial fraction expansion and inverse transformation of 
both terms with Table 4.1 yields 

8 1 10 


ie (st10)2  s+10 (st+i0)2 ° ug(t) = (1—10#)e~**e(£) . (6.9) 


Figure 6.7 shows the input-output relationship in the time-domain and the 
frequency-domain. ‘The behaviour over time of the step function at the input. 
and of the voltages u2(t) and u(t) is depicted in Figure 6.8. 


Figure 6.8: Step function and step response of the independent RC-circuits from Fig 6.6 
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6.3. Poles and Zeros of the System Function 


The system function is a completely different kind of system description of the 
networks in Figures 6.3 and 6.6. Even so, if the circuits are described by fewer 
components, then the corresponding system function will also be simpler. The 
system functions here can be defined by giving all of their poles and zeros together 
with a constant factor. Only rational fraction system functions will occur when 
we are dealing with LTT-systems with a finite number of energy stores. 

As an example we consider the system function of the RC-circuit in (6.6). 
Figure 6.9 shows its magnitude on the complex frequency plane. The zero at 
s = (0 and the pole at ¢ = —10 are easily recogniseable. Their location defines the 
value of H(s) (both magnitude and phase) at all other points on the s-plane. It 
is therefore sufficient to give these points to define H(s) to a constant factor. A 
plot of these points in the s-plane is known as a pole-zero diagram. 


Figure 6.9: The magnitude of a system function 


Two examples of pole-zero diagrams are shown in Figure 6.10, The upper 
diagram represents the system function from Figure 6.9. and the lower diagram 
represents a systern function with double poles and zeros at the same locations. 

Poles and zeros as roots of the numerator and denominator polynomials of a 
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H(s) = 5 Im{s} x - pole 


© - zero 


2 
sag eee Im{s} 
NS) (s +10)? 
Ps double zero 
deine Re{s} 
pole 


Figure 6.10: Examples of pole-zero diagrams 


rational fraction system function can also take complex values. For polynomials 
with real coefficients, however. they always occur in complex conjugate pairs. 
Figure 6.11 shows a simple example. 


Double zero at s = 


Poles s = —-l+3 


Ks? = Ks? 


~ (s+1+7)\(s+1-—j) s?+25+4+2 


Figure 6.11: Pole-zero diagram with conjugated complex poles 


The order of a system is given by the number of poles it has. which is equal to 
the number of independent energy stores. The number of zeros has no influcnce 
on the order of a system. 

We have already briefly remarked in Chapter 3.2.2 that the system function 
also has a region of convergence. Often this relates to causal systems, for which 
the response at the output cannot occur earlier than the cause at the input. For 
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causal systems the region of convergence lies to the right. of a vertical line through 
the rightmost singularity, and with a rational fraction system function, to the 
right of the rightmost pole. The location of zeros has no influence on the region 
of convergence. In order that the Laplace transform of the output signal Y(s) in 
Figure 6.2 exists, the region of convergence of the input signal X(s) and the system 
function Z7(s) must overlap. As the regions of convergence for right-sided input 
signals and causal systems always overlap, if Re{s} is chosen to be large enough, 
the region of convergence of the system function is not normally of interest. The 
region of convergence for system functions in general, not just causal systems, will 
emerge later from the convolution theorem (Chapter 8.4.2). 


6.4 Determining the System Function from Dif- 
ferential Equations 


The system function was found relatively easily from the network in Section 6.2 
through the use of complex impedances. It is even easier to determine the transfer 
function if an LTI-system is given as a differential equation (with constant coef- 
ficients). Use of the differentiation theorem (4.26) replaces every derivative of a 
funetion of time by a product of a power of s and the Laplace transform of the 
function of time. The differential equation then becomes an algebraic equation, 
which immediately yields the transter function. We will show how this is done 
with two examples. 


Example 6.3 
From the differential equation 


2y —- 3y + 5y = 10% — 7x, (6.10) 
use of the differentiation theorem (4.26) yields the algebraic equation 
2s*Y (s) — 3sY(s) + 5Y(s) = 10sX(s) — 7X(s), (6.14) 
from which we can obtain the transfer function 


Y(s) 10s —7 
~ X(s) 2s? -3s4+5 


H(s) (6.12) 


The coefficients of the differential equation come directly from the coefficients of 
the transfer function, 
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Example 6.4 
The reverse is also possible: obtaining a differential equation from a transfer 
function. From the transfer function 
¥(s) Ce a 


cee Se ae ea 6.13 
ON Xa) ea 10)? sh 000 100 so) 


we obtain the algebraic equation 


(s? + 20s + 100) Y(s) = s? X(s), (6.14) 


which, using the differentiation theorem (4.26), corresponds to the differential 
equation 

Y + 20y + 100y = x. (6.15) 

i 


If the input signal cannot be differentiated for all values. the differentiation 
theorem for signals with continuous sections (4.41) must be used. This will be 
covered in detail in Chapter 7. 

The region of convergence of the system function cannot be found from the 
differential equation alone. To determine it, we require further information about 
the causality or stability of the system. Initial condition problems, which will be 
dealt with in Chapter 7, imply that the system we are dealing with is causal. 


6.5 Summarising Example 


In the previous examples only the step response was determined. that is. the 
response to a signal that takes the value zero for ¢ < 0. It represents a special case 
of bilateral signal, that does not excite a system for t < 0. Now we will show how 
to determine the system response to a signal that is always non-zero. 


Example 6.5 
We consider the system response of the RC-circuit. from Example 6.1 to the 
input signal 


a(t) = 3e7%*e(t) + 3e%e(—t) = 3¢7Fl4 (6.16) 
i 
® 
. 3 3 p 
PSY. Se . 5 < Re{s} <5. (6.17) 


8+5 56-5 


With partial fraction expansion, the Laplace transform of the output signal is 
given by 
8 4 3 1 
X(s) = en 

§+10 8s+5 s—5 


(6.18) 
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The region of convergence (ROC) of X(s) lies completely in the region of conver- 
gence of the system function for the causal RC-circuit Re{s} > —10. The inverse 
transform can take place as integration within the ROC —5 < Re{s} < 5. so that 
the first two terms lie left of the ROC and lead to right-sided functions of time 
because of their poles. The third term leads to a left-sided function of time. 


y(t) = de" e(t) — 3e Fe (t) + e*'e(—t). (6.19) 


The signals a(t) and y(t) are illustrated in Figure 6.12. To test this, we begin 
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Figure 6.12: Input and output signals in the time-domain 


with the differential equation of the RC-circuit that can be either taken directly 
from the network in Figure 6.3, or alternatively from the transfer function as in 
Example 6.4: 

y(t) + 10y(t) = a(t). (6.20) 


To show that y(t) (6.19) fulfills the differential equation, we separate the cases 
E<Qandt>0. Fort <0, 


a(t) = 3e*, y(t) = e**. t<O (6.21) 
and therefore ; 
g(t) + WOy(t) = 15e = a(t), ra 0; (6.22) 
For t > 0, 
a(t) = Se", y(t) = 4e~19F — 30% t>0 (6.23) 
and therefore ; 
y(t) + l0y(t) = —-1be~* = Z(t), = t > 0. (6.24) 


‘The output signal (6.19) satisfies the differential equation of the RC-circuit for all 
time ¢ where the input signal can be differentiated. The differential equation is. 
however, not sufficient to confirm the validity of the solution. For example. 


y(t) = —de~'*e(—4) — Bee (t) + e c(t) 
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also fulfills equation (6.20), but does not correspond to the causal RC-circuit. The 
two solutions can be distinguished by the region of convergence of their Laplace 
transforms. 


6.6 Combining Simple LTI-Systems 


Until now, we were only concerned with individual systems and their system func- 
tions, each determined by a given system description or differential equation. In 
Section 1.2.2, we had formulated the goal of system theory as being abstract from 
the details of the system implementation. When describing a system with a sys- 
tem function, we therefore do not always want to first describe all subsystems, or 
recreate the complete differential equation or state-space description. Instead it 
would be more appropriate to obtain the system function directly from the known 
system functions of the subsystems. To do this we only need to know the simple 
relationships between systems connected in common forms. These forms are series 
coupled, parallel coupled and feedback coupled systems. 


6.6.1 Series Coupling 


Figure 6.13 shows two systems with the system functions H,(s) and Ho(s). that 
are coupled in series so that the output signal of H,(s) is the input signal of Ho(s). 
From the system functions 

¥i(s) Y(s) 


Hy (s) = : Ao(s) = = (6.25 
i(s X(s) 2(s) ‘ ( 5) 


we can immediately find the system function of the whole system 
2 Y(s) _ ¥(s) Vils) 

X(s)  ¥i(s) X(s) 
The output signal of a system with system function H(s) = H)(s)H2(s) is therefore 


identical to the output signal of the two systems H\(s) and He(s) in series. Both 
system components can be interchanged without altering the output signal. 


H(s) 


= Hy(s)H,(s) = H,(s)Ho(s). (6.26) 


Example 6.6 


The direct form I shown in Figure 2.1 represents the series coupling of two 
systems. The system functions of the component systems are 
bos +... +by-1s+ bn 


Hy(s) = mae 


(6.27) 


aN 


F4(s) = 


aos’ + ... +an-18+ an 
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identical 


output signals 


| H>(s)-Hy(s) 
x(t) v(t) 


Figure 6.13: Systems in series 


Their product represents the desired system function for the differential equa- 
tion (2.3): 
7 bos™ + ... +bn—184+ by 


Woe) =e ; 
(s) 1(8)H2(s) Ge (6.28) 


As both component systems are interchangeable, we could carry out the transfor- 
mation from direct form I to direct form If shown in Figure 2.2. 


—~ Example 6.7 

The two independent RC-circuits from Example 6.2 are an example of series 
coupling of systems. Their transfer function is the product of the transfer function 
of the two individual RC-circuits from Example 6.1. The decoupling of the two 
circuits with the controlled voltage source (Figure 6.6) is necessary to prevent the 
second system from affecting the first system, 


6.6.2 Parallel Coupling 


The parallel circuit in Figure 6.14 has two component systems with the same input. 
Because the system is linear, 


Y(s) = Hy(s)X(s) + Ho(s)X(s) = [Hy(s) + Ho(s)|X(s) = H(s)X(s). (6.29) 


The output signal of the parallel cicuit is therefore identical to the output signal of 
a system with system function H(s) = H,(s) + H2(s). We have already made use 
of this relationship with partial fraction expansion. Expanding a system function 
into partial fractions is nothing more than the dividing up of a system into simpler 
parts. The parallel form in Figure 2.10 is likewise a division of an order N’ system 
into N first-order systems. 
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A(s) + Hs) 


Figure 6.14: A parallel system 


x(t) 


6.6.3 Feedback 


117 


output signals 


identical 


Systems with feedback like Figure 6.15 are very important in control systems and 
have many useful applications. At the output of feedback systems we find the 


expression 


Y(s) = F(s)[X(s) + G(s)¥(s)}. 


This yields the system function 


0) FE 


1-F(s)G(s) y(t) 


Figure 6.15: A feedback system 


(6.30) 


(6.31) 


output signals 


identical 
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Example 6.8 

Every branch of the parallel form in Figure 2.10 contains a feedback system of 
the kind in Figure 6.15. The transfer function of the integrators comes from the 
integration theorem (4.27), while the transfer function in the feedback path is a 
constant: 


I : : 
F(s)= - Gla Ap. Bedi. aN. (6.32) 


‘Together with the relationship for series coupling, the transfer fuuction of each 
path is 


(6.33) 


The entire transfer function can be obtained with the parallel coupling relationship. 
as the sum of all partial transfer functions H;(s),1= 1,....N. 


a a a rt a Ge a EB 


Example 6.9 


If a system with transfer function F'(s) is an ideal amplifier with amplification 
factor V, then F(s) = v. The transfer function of the feedback system is then 


V 1 “3 
Hey Te VveG) ae Gis)’ oe 


If the amplification is very high, then the approximation 


1 


NS Ce 


(6.35) 


can be used. This means that the inverse of a transfer function G(s) can be im- 
plemented by a feedback system. The high amplification required can be achieved 
using operational amplifiers (see Chapter 2.2.5). 


6.7 Combining LTI-Systems with Multiple Inputs 
and Outputs 


The rules discussed in the last section for series, parallel and feedback coupling 
of systems can also be combined and used to analyse complicated block circuit 
diagrams. We are still confined, however, to systems with only one input and one 
output. We now would like to extend these rules to cover systems with multiple 
inputs and outputs. 
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We have already met systems with multiple inputs and outputs in Chap- 
ters 2.3.2, 2.5 and 2.6. The transfer function of a system with J input signals 
and K output signals is a K x M matrix H(s) which combines the vectors X(s) 
of the transformed input signals and the vectors Y(s) of the transformed output 
signals (see (6.5) }. 


¥(s) = H(s)X(s) . (6.36) 


The individual elements of the matrix H(s) are the scalar transfer functions be- 
tween the individual components of the input and output vectors X(s) and Y¥(s). 
The element in row «, column yu is the transfer function between the input num- 
bered yz and the output numbered « 


¥n(8) = Hep(s)Xp(8) « (6.37) 


The rules for combining systems with multiple inputs and outputs are obtained 
with the laws of matrix calculation in the same way as in the last section for only 
one input and output. 


6.7.1 Series Circuits 


The series circuit for two systems with multiple inputs and outputs is shown in 
Figure 6.16. Of course, the number of inputs of the second system must be the 
same as the number of outputs of the first system — then the matrices of the 
transfer functions H,(s) and Ha(s) are compatible, and we can express the transfer 
function of the complete system with Hy(s) and He(s). With 


Yi(s) =Hy(s)X(s). Ys) = Ha(s)V¥i(s) (6.38) 
we find for H(s) 
Y (5) = Ha(s)¥1(s) = Ha(s)H, (s) X(0) = H(s)X(s) (6.39) 
H(s) 
and therefore = 
| His) = H.(s)Hi(s) . (6.40) 


In contrast to systems with only one input and output, the matrices H,(s) and 
Ho2(s) cannot be interchanged. 


6.7.2 Parallel Circuits 


If two systems are to be connected in parallel (Figure 6.17), the number of both 
inputs and outputs must be the same for both systems. Under these conditions, 
the matrices H,(s) and He(s) each have the same number of rows and the same 
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he) p= 
x) yi) y(t) output signals 
identical 
Bs(s)- ys) 
x() y(t) 


Figure 6.16: Series coupling of systems 


number of columns. We can then express the addition of the output signals by an 
addition of the system functions 


Y(s) = Hi(s)X(s) -+- Ho(s)X(s) = [Hi(s) + Ho(s)| X(s) = H(s)X(s). (6.41) 
H(s) 


This yields 


| H(s) = Hi(s) + Ha(9) | (6.42) 


output signals 


identical 


Hiy(s) + H)(s) 
x(Z) y) 


Figure 6.17: Systems coupled in parallel 


6.7.3 Feedback 


Figure 6.18 shows a feedback system with multiple inputs and outputs. Here we 
must take special care with the dimensions of the matrices. We begin with addition 
at the input. All vectors here must have the same number of elements. If input 
vector X{s) has M clements. then matrix F({s) must have AZ columns, and matrix 
G(s) must have M rows. At the output, the signal Y(s) from the output of F(s) 
is combined with the input of G(s), so if ¥(s) has K elements, F(s) must have iv 
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columns. Therefore F(s) must be a K x M matrix, and G(s) must bea M x K 
matrix. 

To determine the transfer function, we consider the output (as in (6.30)). For 
Y(s) we can write 


Y(s) = F(s)[X(s) + G(s) ¥(s)]. (6.43) 
We bring the terms containing Y(s) to the right-hand side and factorise Y(s) 
[I — F(s)G(s)] ¥(s) = F(s)X(s). (6.44) 


Here, Lis a K x K unity matrix, so the product F(s)G(s) likewise has dimensions 
Kx K. Again special care must be taken over the correct. sequence of the matrices. 
As the matrix in the square brackets is quadratic (K x kK), it can be inverted. as 
long as none of its eigenvalues are zero. With this condition, 


¥(s) = [I— F(s)G(s)]-'F(s) X(s) = H(s)X(s). (6.45) 
enero, poten re” 
H(s) 


and 


H(s) = [I— F(s)G(s)]"'F(s). (6.46) 


The transfer function matrix H(s) is given by the transfer functions F(s) in 
the forward branch and G(s) in the reverse branch, as in the scalar case if we 
replace the division in (6.31) by a matrix inversion and note that the order of the 
matrix multiplication F{s)G(s) cannot be changed. 


identical 


output signals 


<r - F(s\G(syf! F(s) == 
x(1) y(t) 


Figure 6.18: A feedback system 


6.8 Analysis of State-Space Descriptions 


The rules we have considered for the parallel, series and feedback circuits for 
systems with multiple inputs and outputs are entirely sufficient for analysis of 
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many LI'l-systems. As an example for their systematic use, we will calculate the 
transfer function of a general state-space representation for a system with multiple 
inputs and outputs as shown in the block diagram in Figure 6.19. It represents the 
state-equations (2.33,2.34) described in Chapter 2.3.2. As before, we start with 


a vector x(t) with M input signals, 
a vector y(t) with K output signals and 
a vector z(t) with N state variables 


The matrices of the state-space model then have dimensions 


A Nx WN, 
B NxM, 
C AXxN, 
D Kx M. 


Figure 6.19: Block diagram of a state-space representation 


The complete transfer function H(s) for this state-space representation is ob- 
tained by suitable analysis of component transfer functions and by applying the 
rules for combining LTI-systems step-by-step. First of all, we recognise a parallel 
circuit in Figure 6.19. with two component systems with the transfer functions 
Hy (s) and H2(s). 


Hi(s)=D, (6.47) 


which means that the transfer functions in the direct path between input and 
output are all constant. From (6.42) we know that for the transfer function H(s), 


H(s) =H; (s) + H(s) : (6.48) 


The component transfer function H2(s) must be determined from the lower path. 
It consists of three systems in series (6.40) 


H2(s) = Hy3(s)H22(s)Hai(s) (6.49) 
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with 
Hai(s) =B, Ho3(s) = C. (6.50) 


The component transfer function H22(s) is obtained by analysing the feedback 
system that consists of the loops 2(¢) and a(t). with the notation 


1 
F(s) = ac G(s)=A (6.51) 
we obtain with (6.46), 

coe ee a are 
Ho2(s) = |l~ 2 LA b= jsl — Al ‘ (6.52) 
Tis a unity matrix, size N x N. Now all component transfer functions have been 

found, we obtain from (6.48) and (6.49), the complete transfer function is 
H(s) = H3(s)Ho2(s)H21(s) a H, (s) (6.53) 


or with (6.47), (6.50) and (6.52) 


H(s) =C SE ~A\'B+D. | (6.54) 


By applying the rules for combining LTl-systems, we have found the fundamen- 
tal connection between the matrices of the state-space model, and the transfer 
function of a system with multiple inputs and outputs. 


6.9 Exercises 


Exercise 6.1 


Determine the transfer function H(s) of the following series resonant circuit using 
complex impedances. 


L R 


oa 4—— R=] 
u(t) | C AG) L=05 
[eee C=04 


Caleulate the step response to(t). 


Exercise 6.2 

Draw the function u(t) = ¢(t)e~T and the tangent at the point u(0). The tangent 
can be used to help construct the graph of exponential functions, if its point of 
intersection with the z-axis is known. Determine the point of intersection. 
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Exercise 6.3 


Determine the transfer function that has the following pole-zero diagram. 
a) Imi{s} b) ,Im{s} c) Im{s} 4d) Im{s} 


2 
Re{s} 1 Re{s} 
Se ee ee 
“ -3 -1 4 


Exercise 6.4 


Two systems are given by differential equations: 


a) ¥+2y+y= #440440 


d’y d?y dy ae dx ., 
b} => +35—> 25— + Tay = —> +4— -— 21a 
Pgh 8 gee PAO ga US ae ae 


Determine the transfer functions H(s) and draw the pole-zero diagrams of the 
systems. 


Exercise 6.5 
Determine the transfer function and the differential equation of the system with 
the following pole-zero diagram and H(0) = 1 


x45 Im{s} 


3+ — i 
2-1/1 Refs} 


7 Solving Initial Condition 
Problems with the Laplace 
Transform 


We assumed when we considered the response of systems to bilateral signals, that 
the input signal of a system for time —oo < t < co is known. The system response 
depended exclusively on the input signal, and the case where the input signal is 
zero for t < 0 and the system is at rest for t < 0, was included. 

In many cases, observation of a system is started at a particular point in time. 
The input signal before the point is unknown, but all that is needed to represent 
the past history of a system is knowledge of the system state at the time when 
observation begins. Evaluation of the system response must therefore rely on the 
state found before the start, and the behaviour of the input signal since then. In 
the terminology of differential calculus this is an aniteal condition problem. 

The way the system state can be given depends on the available description 
of the system. For a description of a physical structure, for example, an electrical 
network, the state of the energy stores is available. For a description that uses 
block diagrams or a state-space structure, the states of the integrators or state- 
values can be given. If only the differential equation of a system is known, such 
internal values cannot be observed, but instead, the past history can be represented 
by the value of the output and its derivatives, at the time that the observation 
starts. 

In order to discuss the solution of initial condition problems in depth. we begin 
with first-order systems because they make the general principle clear. Second- 
order and higher-order systems follow on from there. 


7.1 First-Order Systems 


First-order systems will be described by differential equations like (2.3) for N = 
M = 1 


axy(t) + aoy() = G2(t) + Box(t). (7.1) 
The input variable x(t) and the output variable y(t) are only defined for ¢ > 0, 


and the values 7(0) and y(0) at the start of observation are known and can have 
any value. The inital value of the output signal y(0) is the result of the unkown 
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past history of the system, The input variable z(t) is given, and we want to find 
the system response y(t) for t > 0. 

We start. with the classical procedure for solving initial condition problems, 
and later we will use the Laplace transform. 


7.1.1 Classical Solution of Initial Condition Problems 


The starting point for the classical solution to the problem described above consists 
of calculating the solution of the homogenous problem and of a particular solution 
of the non-homogenous problem. A general solution is formed from the sum of 
the two, in which the previously open parameters are defined, so that the solution 
fulfills the initial conditions. The following example shows this classical solution 
for a first-order system. 


Example 7.1 
We simplify the problem by specialising the coefficients in (7.1) and examining 
the differential equation 


cy(t) + 2y(t) = ré(t)+a(t), t>0 (7.2) 
x(t) = xp coswot, t>0O.a9 <€IR (7.3) 
y(0) = yo. yo EAR (7.4) 


The homogenous solution y(t) must fulfill the differential equation zy,(t) + 
2yn(t) = 0 and in this case it is 


ynl(t) = Certs. (7.5) 


It can be easily verified by inserting it into the differential equation. C is any 
constant, and will be given a value later, by the inital condition (7.4). 

To calculate a specific solution y,(¢) of the non-homogenous problem (7.2), 
(7.3), we use the harmonic character of x(l) (see (7.3)), and write x(t) and y,(¢) 
for t > 0 as 


a(t) = Re {xge?*} (7.6) 
Re {Yer™o"} , (7.7) 


Ss 
ww 
ic 
~~ 
I! 


with the complex amplitude Y not yet determined. Inserting into (7.2) yields 
(2 + jwo ever = (1+ jwo tage?! é (7.8) 
The complex amplitude is 


14+ jwot jO( 
= tg = P(w) ag 7 8) , (7.9) 
2+ jwot , (wo}o 
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with 


I + {wo z)? 
4+ (wot)? 


P(wo) = O(wo) = arctan(wy 7) — arctan(wo 7/2). (7.10) 


Substituting in (7.7) gives a particular solution 
ys(t) = P(wo)x9 cos (wot + O(wo)) « (7.11) 


The general solution is obtained by adding the homogenous solution with the 
yet undetermined constant C’ and the particular solution of the non-homogenous 
problem: 


y(t) = yn (t) + yg (t) = C672’ = + P(wo) ao cos (wot + O(wo)) - (7.12) 
It, fulfills the inital conditions (7.4) for 
C = yp ~— P(wo)x9 cos(O(wo)) . (7.13) 
Finally, we have found the output signal 


y(t) = ype 2"/® 4 Plwo)z0 [eos (wot + O(wa)) — eT cos @(wo))| . (7.14) 
oe ae i 


To assess this kind of solution, the following points must be noted. 


e® The homogenous solution can only be found this easily for first-order systems. 
In the general case we must first determine the complete set of characteristic 
frequencies of the system. 


e The harmonic form of the input signal x(t) was used to determine the par- 
ticular solution. For other input signals this can be much more difficult. 


If prior knowledge of the characteristic frequencies of the system is necessary and 
an input signal of harmonic form is advantageous, a method like the Laplace trans- 
form. that represents signals and LTI-systems by exponential frequencies sounds 
ideal. We will show this in the next section, by comparing how a first-order system 
is analysed with the Laplace transform. 


7.1.2 External and Internal Parts of the Solution 


To analyse a first-order system with the Laplace transform we start with the 
differential equation (7.1). For the input signal x(t) we do not take any particular 
function, and instead we set the following requirements 


6 x(t) is a right-sided signal, with x(t) = 0 for t < 0, 
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e x(t) can be differentiated for t > 0, 
@ x(t) is of exponential order for t > oo. 


We can now be sure that the Laplace transform of x(t) exists, although we must 
consider a possible step at t = 0, so that the differentiation theorem (4.34) can be 
used. If we only consider the differential equation for t > 0, then a(t) = 2°(t). We 
can then use the differentiation theorem in the form (4.35) for the initial condition 
problem. 


ey(t) +agy(t) = Brett) + Box(t), t> 0 (7.15) 
y(0) = yo Peo 
This leads to the algebraic equation 

ay[s¥(s) — y(0)| + ao ¥ (s) = Bif[sX(s) — 2(0)] + SoX(s). (7.16) 

which can be solved for the Laplace transform of the output signal: 

V1.8 + Bo L , 
VG). =. Se ies ory (0) — 8, 2(0 
(s) = BREE X (9) + ———faru(0) ~ A120) 


= H(s)X(s)+ ——— [ery(0) — j,a(0)). (7.17) 

We can already see in the frequency-domain that the output signal consists of 
two parts. The first part contains the input signal for t > 0, weighted with the 
transfer function ; ; 

H(s) = yet ee (7.18) 

1S + Ao 

and is known as the external part. The second part is given by the values of 

the input and output signals at time t = 0 and is divided by the denominator 

polynomial! of the transfer function. The numerator of the second part does not 

depend on s. We will call this the anternal part. because as we will soon see, it 

corresponds to the internal initial state 2(0) of the system. ‘The output signal itself 
is the inverse Laplace transform of both parts. 

The result of combining the two parts is clarified in Figure 7.1. The external 
part is calculated in the frequency-domain with Y.x.(s) = H(s)X(s), and the 
internal part depends on a further transfer function G(s) of the system state at 
t= 0, At the input of G(s), the initial state 2(0) appears, which does not depend 
on the complex frequency, but instead on a constant in the Laplace-domain’. In 
the following section we will meet a procedure which allows us to determine G(s) in 
a similarly simple way as H(s), without having to worry about the differentiation 
theorem for signals with discontinuities. The combination of internal and external 
parts as shown in Figure 7.1 also works for higher-order systems as we will show 
in Section 7.3. The initial state (0) is in that case. of course, a vector. and G(s) 
is an LTT-system with multiple inputs. 


lWe will see in Chapter 9 that this corresponds to a delta umpulse in the time-domain. 
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=(O) 


X(s) Yox(s) ¥(s) e-o y(t) 


Figure 7.1: Combination of the internal and external part 


7.1.3 Initial Values and Initial States 


It is important to have a good grasp of the difference between the terms ¢itzal 
value and anitial state. 


e The initial value is the value of the output segnal at time t = 0. For signals 
with a step at ¢ = 0, this is the value of the right-hand limit y(0+), regardless 
of whether or not the plus sign is written. 


e The initial state is the value of the internal states at time t = 0. It can be 
interpreted as the contents of the energy stores and is usually constant for 
physical reasons, especially at ¢ = 0. 


While the initial value is the same for all different realisations of a system. different 
initial states correspond to different state representations of the same differential 
equation. 

If a system is initially at rest, then <(0) = 0 and correspondingly Yi (s) = 0. 
and Yine(t) = O V4. The solution of the initial condition problem then only consists 


only arise when the input signal x(t) is turned on. On the other hand, if we have 
an initial condition problem where y(0+) = Yex:(O+), this implies that the system 
is initially at rest. We therefore say that these are natural initial conditions. 


Example 7.2 

Figure 7.2 shows a first-order system with the differential equation (7.1) in a 
direct form I structure (compare with Figure 2.3). In contrast to having just a 
differential equation, we now also know the internal structure of the system. We 
must not forget, however, that there are many different structures that represent 
the same differential equation (see Chapter 2.5). 

As we want to know the situation when the input signal is applied (at time 
t = 0), we express the output signal for this time point by the input signal a:(0) 
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and the initial state by (0). The relationship can be taken from Figure 7.2: 
1 ; : 
y(0) = [x(0) — 102(0)] 81 + o2(0). (7.19) 
By rearranging we can obtain 
a y(O) — Brx(0) = 2(0)la1 89 — ao fi]. (7.20) 
Putting this into (7.17) yields 


a1 89 — aft 


Y(s) = H(s)X(s) + G(s)z(0) with G(s)= (7.21) 


O18 + oO 


This shows that the internal part is determined by the initial state of the integrator 
in Figure 7.2. 


x(t) 


Figure 7.2: First-order system in direct. form II 


Example 7.3 


Tu order to further clarify the meaning of the initial state, we consider the 
RC-circuit from Example 6.1. From the node equation 


: , 1 Eee 
(uy = tig)C = Ri (7.22) 

and the time constant 7 = RC, the differential equation 
gt + Ug = UT (7,23) 


follows immediately, and from that, using the differentiation theorem, we obtain 


St c 


Ty, 8 
st+1 MS) Sea 


Uo(s) = fug(O) — uy (0)). (7.24) 
Note that the content of the square brackets is the value of the voltage across the 
capacitor 

uc(t) = ug(t) — uy (t) (7.25) 
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at. t = 0, so we can also express the Laplace transform of u2(t) by uc(0): 


8t t : 
5 (3) = Ni(s)-4 uc). 7.26 
Uo(s) spa te) Fae uc (0) (7.26) 


Comparison with (7.21) shows that in this case the initial state corresponds to the 
—E 


If this initial state is equal to zero, the system description has the form (6.5), 
that we know from bilateral signals. To explain this, we consider the system from 
the standpoint of a bilateral signal: when a right-sided signal is made bilateral, 
and it is zero for t < 0, the energy stores at ¢ = 0 can have no non-zero initial 
state, and wo say that the system is initially at rest. Whether considered as a 
right-sided or a bilateral signal, for a system initially at rest. we get the same 
result, 

Tt can be seen in Example 7.3 that the initial state and initial value should not 
be confused. If the capacitor is not loaded initially, (uc (0) = 0), the initial state 
is clearly zero, but the initial value of the output is wo(0) = u1(0). 

Under what conditions is the initial value of the output signal zero, if the system 
is energy-less at ¢ = 07 To answer this, we integrate the differential equation (7.1) 
from —oo to 0, and obtain (compare (2.4)) 


0 0 
ayy(0) + aD | y(t) dt = By x(0) + Bo | x(t) dt. (7.27) 


If the input signal for t = 0 is zero, and the system is causal, this is also true 
for the output signal. Both integrals then disappear, but the relationship for the 
natural initial conditions of a first-order initial value problem remains 


ayy(0) = 5)2(0). (7.28) 


We have already obtained this result for the special case of the direct form H 
realisation in Example 7.2. when. the initial state disappeared, From (7.28) it can 
be read that y(0) = 0 only when 8, = 0, regardless of the input signal. Put 
differently: a first-order system with no direct path from input to output(3, = 0, 
Figure 7.2) and without excitation before time t = 0, has an output signal y(0) 
equal to zero. For 3, 4 0, the initial value y(0) depends on the value x{0) of the 


input signal (7.28). 


Example 7.4 

What significance does the initial value have for systems which are not intially 
(t = 0) free of energy? To answer this question, we consider the system from 
Example 7.1 and apply a bilateral signal 


E(t) = rq coswot, -oo <t< ow (7.29) 
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and a unilateral signal a(t) = Z(t), t > 0 to it (7.3). The response y(t) to #(#) can 
be obtained, for example, using complex amplitudes. Its form can be taken from 
Example 7.1. where we ensured that the general solution (7.12) was valid for input 
signals that can be differentiated, even for t < 0. As the input signal consists of 
two eigenfunctions of a LTI-system, the output signal 9(¢) must be made up of the 
same eigenfunctions, and therefore yields from (7.12) with C = 0 


y(t) = P(wo)ay cos(wot + O(wo)). (7.30) 


The response y(¢) to the unilateral signal x(t) has already been determined (7.14). 
We express it here somewhat differently: 


y(t) = P(wo)to cos(wot + O(wo)) + [yn — Pwo) cos Ow) e7247*, ot > 0. 
(7.31) 
If we choose the initial value yo in (7.31) to be the same as the value 9(0) in (7.30), 
the second part then disappears from (7.31) aud for t > 0. 9(t) = y(t). 

This means that we can also determine the response to a bilateral signal Z(£) 
for t > 0 by applying a unilateral signal a(t) = £(#t)e(t), if the initial value y(0) 
is set equal to the response to Z(t) at time t = 0. In other words, we choose the 
initial value yo so that it contains the complete past history of the system, and 
thus avoid transient behaviour for { > 0. 


7.1.4 Example: Initial Condition Problem with a Sinusoidal 
Signal 
We can now use the Laplace transform to solve initial condition problems. In elec- 


tical engineering, initial condition problems with sinusoidal signals are particularly 
important. 


Example 7.5 

As an example we consider the exercise from Example 7.1, which used the 
classical method of solution. We take the Laplace transform X(s)e-—ox(t) of the 
input signal from Table 4.1 and then obtain with (7.17), 


Y(s) = rext(8) + Yine(s) 
test] Lg 8 f a 
wst+2 s?+up  ra+2 


[Yo ro) 


= Bae a lls ot Yn ~~ 2 7.32 
S—Se S?twh s- sa 0 ws) 
Sores pala (7.33) 
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The output signal is given by the inverse Laplace transform, for which we treat 
both terms separately. For the first term Yoxt(s) = A(s)X(s), the inverse trans- 
form is easiest when we represent it as a partial fraction, and the calculation of 
the partial fraction coefficients can be simplified by first of all representing /(s) 
and X(s) with partial fractions: 


5 | 
A(s) = — oe ee pane 
§ — 8o0 eee ule . 
| ma ee Be 1 (7.34) 
X(s)= a3 = | pe ee 
82+ uw? S-jJwo $+ jug 2 


From here the partial fraction coefficients C and D of H(s).X(s) follow immediately 


oo Cc D D* : 
H(s)X(s) = ———-+- + (7.35) 
8-85 S~jJwp $+ jwo 
, 200 Spee 
C = (8— 8_)H(s)X(s)|,. = AX (800) = tock (7.36) 
D = (8—jwo)H(s)X(s) sua = F(jwo)Bxo (7.37) 
_ xo L+ Jwyt 
~ 224 quot! 
The inverse transformation is now easy to perform using Table 4.1: 

Vext (t) = L4H (s)X(s)} = Ce 2% 4 D eivot 4+ D* est, (7.38) 


In order to bring the complex conjugates together, it is useful to express the coef- 
ficients D by their phase and magnitude. Then it will occur to us that H (yw )ao 
is identical with the complex amplitude Y (7.9). That is no coincidence. as the 
complex amplitude of the output signal for a sinusoidal input signal corresponds 
to the value of the transfer function at this location. The magnitude and phase of 


H(jw)%o are therefore the same for P(wo) and O(wo) (see (7.10)). 


pate ae © Panay (ke 7.39 
|H(qwo)| (wo) \ 4+ (wot)? ( ) 
arg{IT(jwo)} = Ow) = arctan(woz) — arctan(woz/2). (7.40) 
With 
eto Seite le. 4) 

D=|BGwaljer "+ Pe (7.41) 

we obtain 
Yext(t) = Ce AMEE oh | (ju) |29 cos(wot + Olaiy)). (7.42) 


The internal term is obtained by inverse transforming the second term in (7.32): 


8 = Seq 


vine) = 2} —— tao — tol} = [on ~ ale. (7.43) 


134 7. Solving Initial Condition Problems with the Laplace Transform 


With (7.36). (7.43) it now follows that the output signal for ¢ > 0 is 
2X0 _ 94) . ; F 9 
2+ (lage? ePE + | FT jurq)|ato cos(wot + O(wo)) + [yo — zole72"/= . 


casement mtcsunatneeiey, gsc aneetete oronmnnnitrmenminene 
external part 


y(t) = 
internal part 


(7.44) 
To conclude, we express this result in the same form as the result of the classical 


solution (7.44). The terms with xq e~?"/ are collected together, giving 


2 fad 2+ (wot)? ] _ peat ee ee tie cie 
E “CoG; =| 7 F rs oa | a Aaa cca 


and the result is then put into (7.44). The fal result corresponds to (7.14). 


For a sinusoidal input signal, as considered in the previous example, we can 
further divide up the external term of the system response so that (7.44) consists 
of three parts 


229 


7) a eo carr aaa ts gree Pts | H(jwo)|aq cos(wot + O(wo)) + [yo — Bole2t/ © 
A + (wor)? Nc J 
. 7 > “ite tion art ray part 
transient part enna iee decay part 
(7.46) 


These terms can be interpreted as follows: 


@ The transient part determines how the system responds to an input starting 
at t = 0. It is formed from the characteristic frequency of the system, the 
complex frequency sx, (Ae&eto--eA/(s — $.,)) and the value of the Laplace 
transform of the input signal X(s,,) at the system’s characteristic frequency. 
For stable systems (Re{s..} <0), this part decays over time. 


e The ercitation partis the part of the input signal that appears at the output 
of the system. It determines the steady-state response of the system and 
neglects the single-sided character of the input signal. [t is identical to the 
result obtained by using complex amplitudes. The excitation part is defined 
in terms of magnitude and phase of the frequency response. They determine 
the amplitude and phase of the output signal. 


e The decay part is identical to the internal part and represents the response 
to the initial state. Similar to the transient part, it decays with the complex 
frequency of the system. 


The transient part and the excitation part comprise the first term in (7.17, 
7,44) (L{H{s)X(s)}). ie. the external part. The separation of the external part 
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into transient and excitation parts is performed by partial fraction expansion. The 
pole of the system (s = so) determines the transient part and the poles of the 
excitation (s = +jwo) determine the excitation part. As already mentioned above, 
the decay part is identical to the second term in (7.17. 7.44), ie. the internal part. 


7.1.5 Summary 


The results of our intensive investigation of first-order initial condition problems 
can be summarised by the following points: 


e The Laplace transform allows the response of an LT I-system to unilateral 
signals to be determined just as elegantly as with bilateral signals. 


e Use of the differentiation theorem for right-sided signals treats a step in the 
input signal at ¢ = 0 as a pre-determined initial value of the output signal. 


® ‘The response to a right-sided signal can be split into an internal and an 
external term. 


e If the input signal is sinusoidal, the external term can be further split into a 
transient part and an excitation part. 


e If both the differential equation and the internal structure of an LTI-system 
are known, the internal term can be interpreted as the response of the system 
to the initial state. 


e The initial state of a system completely summarises the effects of its past 
history. 


These results have been derived from first-order systems but they also apply to 


higher-order systems. In the following sections, we will show this for second-order 
systems and general systems of any order in the state-space description. 


7.2 Second-Order Systems 
The differential equation(2.3) is used for second-order systems 

O2y +ayy +aoy = GF 4+ Oe + Box. (7.47) 
Analysis with the Laplace transform uses the differentiation theorem for right- 
sided signals (4.34), for the first and second derivatives. For ¢ > 0, #°(t) = &(t), 


and we obtain 


L{t} = sk{a}—2x(0) = sX(s)— (0) (7.48) 
L{#} = sL{z} — 2(0) s’X(s) — [sa(0) + &(0)]. (7.49) 


tl 
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The bounds (0) and #(0) are again right-sided bounds. Using (7.48. 7.49) on 
(7.47) yields after rearrangement: 


[287 + as + ap|¥(s) ~— sagy(0) — [ayy(0) + agy(0)} = 


ds : ; ; 7.50 
(328° + B18 + Bo)X(s) — s8ox(0) — [31 2(0) + B2&(0)). ed) 


For a unique solution we require two initial conditions. the value of the output 
signal y(0) and its first derivative y(0). The corresponding values «(0) and «(0) of 
the input signals are known. We can then solve (7.50) for the Laplace transform 
of the unknown solution Y(s) and obtain with the system function [H1(s) 


Bys* + B18 + 3p 
ags? + aps + ag 


H(s) = (7.51) 


the solution 
Y(s) = H(s)X(s)+ 
“pe Se ech, & 2 Bh dgiring (7.52) 
sloay(0) — 3y2(0)) + lary(0) + a2y(0) — Brx(0) — Bg4(0)] 
gs? + a18 + a ; 


The output signal y(t) in the time-domain is found from (7.52) using the inverse 
Laplace transform. The first term gives the external part of the system response 
and the second term gives the internal part. 

lf the internal structure of the system is known, we can represent the internal 
part by the initial states. Depending on the structure of the system, different 
expressions are obtained. The relationships are especially simple with direct form 
Ill. which is shown in Figure 7.3 for the second order differential equation (7.47). 
In contrast to Fig 2.5 for order N systems, the original notation (a,, 3;,) for the 
coefficients is kept. At the output of Figure 7.3. we can read that (compare (2.18) 
for N = 2) 

8 


Pa 
y(t) = —2z1(t) + a(t). (7.53) 
9 a2 


At the middle summing node (compare (2.15) for N = 2) 
21(t) = 20(t) + Bya(t) — ary(t). (7.54) 
Differentiating (7.53) and substituting in (7.54) yields 


Oy By 
at) = (t) - 
u@) at )+ a2 


see 1 , OY a 

b(t) + —29(t) y(t). (7.55) 
v9 Og 

From (7.53) and (7.55) we solve for the states when t = 0 


(0) = agy(0) — Sox(0) (7.56) 
29(0) = ayy(0) + agy(O) = B,2(0) = 3gt:(0) ‘ (7.57) 
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x(t) 


Figure 7.3: Second-order system in direct form III 


We can now express the cumbersome terms in (7.52) much more simply using both 
of the initial states: 


PajS tier oe eO. (7.58) 


ags® +ayst+ ay 


Replacing initial values by initial states is also possible with other structures. 
although the resulting expressions are not always as simple as in (7.58). 


7.3 Higher-Order Systems 


The Laplace transform has so far been shown to be an effective tool for solving 
initial condition problems for first- and second-order systems. It can be used 
in the same way for higher-order systems. For this purpose, the differentiation 
theorem as in (7.48) and (7.49) must be extended to higher derivatives. From 
the differential equation of order N in (2.3). we can obtain an algebraic equation 
that leads to a system function H(s) with a polynomial denominator of order N. 
The internal part contains N initial valucs y(0), y(0).4(0)....,y%-P(0). up to 
the (N—1)th derivative and also the corresponding values of the input signal. As 
the expressions that arise rapidly become involved, however, it is helpful to switch 
over to the state-space description (see (2.40) to (2.43)). This can be readily done, 
when the internal structure of the system is known. Otherwise, the matrices A. 
B, C, D can be written down from the coefficients of the differential equation 
for direct forms I, If and IIL. The arbitrary states thus obtained have no physical 
meaning, but the advantage of the simplified notation still remains. 
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7.3.1 Solution of the State-Space Differential Equation 


We start with the order N system with one input and one output that is given by 
the state-space description (2.33), (2.34). It could have any internal structure, and 
80 also any coefficients for matrices A, B. C, D. To use the Laplace transform on 
this system of N first-order differential equations we only need the differentiation 
theorem for the first derivative. Used on the state vector 2(1) it is 


L{a(t)} = sZ(s) — 2(0). (7.59) 
The Laplace transform here refers to the individual components of the state vectors 


ZY (s) 
L{z(t)} = Z(s) = ; with Z;(s) = L{2,(t)}. (7.60) 
Zn (8) 


The initial states are collected together as vector 2(0)*. The state-space description 
in the time-domain (see (2.33, 2.34)) becomes 


sZ(s)-z(0) = AZ(s)+BX(s) (7.61) 
Y(s) CZ(s) + DX(s) (7.62) 


Hl 


in the frequency-domain. The differential equation then becomes the algebraic 
equation system (7.61), which we can solve for the state vector transform Z(s). 
Collecting the terms with Z(s) together, we notice that sZ(s) — AZ(s) = (sI — 
A)Z(s), where [is the unity matrix. We obtain 


Z(s) = (sl — A)~'BX(s) + (sI— A)~'z(0). (7.63) 


The inverse of the matrix (sI— A) must stay on the left because the matrix product 
is not commutative. 

By inverse Laplace transformation (7.63), the time behaviour of the state vari- 
ables can be determined if it is of interest. Here we are looking for the output 
signal y(t). however, and so we substitute (7.63) into (7.62). The result is 


Y(s) = H(s)X(s) + G(s)z(0) (7.64) 
Eee aber eae eee ter Se eres 


2 At first glance, it is surprising that for the state 2(4) we use the differentiation theorem for 
functions discontinuous at ¢ = 0 (7.59), while z(t) 1s usually continuous for physical reasons. 
However, we do not know a(t) for ¢ < 0, so we arbitrarily set 2(¢) = 0 Vt < 0 and let the state 
at time t = 0 jump to z(0). 
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with system function A(s) and column vector G(s) 


H(s) = C(sI-—A)'B+D | (7.65) 
G(s) = C(sI—A)'. (7.66) 
| 

The equation (7.64) has the same structure as (7.21) and (7.58): it is just the 
initial states combined as a vector. Equation (7.65) describes in a general form 
how to calculate the transfer function from the mput to the output of a state-space 
structure, from the matrices A, B, C, D. This problem has already been dealt 
with in Chapter 6.8. G(s) can in any case be interpreted as a vector of transfer 
functions. The individual components describe the transfer behaviour from the 
input of the individual integrators to the output of the whole system. ‘The 
expression s G(s) is the vector of the transfer functions from the state variables 
4(s) to the output of the whole system, that arise at the integrator outputs. 

The important equation (7.64) is illustrated in Figure 7.4. The response of the 
Nth order LTI-system with initial conditions to an input signal «(f)o-—-eX(s) is 
obtained by computing the response X(s) - H(s)e-—oyex:(t) of a system initially 
at rest and adding G(s)z(0)e—oyin,(£). The N initial states 2(0) must be chosen 
such that the complete solution y(t) = Yyexi(t) + yint (t) fulfills the initial conditions. 


z(0) 


Fint(s) e-0 Yin) 


aoe. 
x(tho—e X(s) Yoxt(S) @-0 Vex(f) y(t) 


Figure 7.4: Solution of initial condition. problems in the Laplace-domain with (7.64) 


Calculating the system function H(s) with (7.65) seems to be contradictory: 
while the system function is clearly fixed by the given differential equation (see Ex- 
amples 6.3 and 6.4), in (7.65) matrices occur that depend on the chosen state-space 
model. Does the transfer function therefore depend on the internal structure? To 
show that the transfer function really is the same for all equivalent state-space 
structures, we insert the state matrices of an equivalent structure (2.47)-(2.50) 
into (7.65), and obtain 


H(s) = C(st- A)'B+D=CT(sT T- TAT) 'T'B+D= 
= C(sI—A)'B+D. (7.67 


The transformation matrix T disappears when the system function is calculated 
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and so all equivalent state-space structures have the same system function. The 
matrix expression on the right-hand side (7.65) is said to be invariant for similarity 
transformations. However, the vector of transfer functions G(s) from the states 
to the output depends on the structure of the system. A similarity transformation 
changes it to 


G(s) = C(sI—A)-! = OT(sT 1 T- TAT) 3 = 
= C(sl~A)'T = G(s)T. (7,68) 


(7.67) can be made much clearer by manipulating the block diagrams in Figures 7.5 


Figure 7.6: Moving the transformation matrices 


and 7.6. In Figure 7.5 the matrix multiplications are first represented by cascading 
multiplications by A, B and C with T and T~! in accordance with (2.47) - (2.50). 
The linearity of T and T~! allows these blocks to be shifted as shown in Figure 7.6, 
without changing the transfer behaviour of the system. In the central path of 
Figure 7.6 . we see the transfer function TsIT~! = s[TT~! = sI, which does not 
depend on T. We have now shown that H(s) does not depend on the similarity 
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+ 


transformation 'T. This is also true, as shown in Figures 7.5 and 7.6, for systems 
with any number of inputs and outputs. G(s) can be interpreted in Figure 7.6 as 
a vector of transfer functions from the input of the integrator to the output and 
(7.68) can be directly written down from this. 

We will clarify the connection between determining the system function from a 
state-space structure as in (7.65) and determining it from a differential equation, 
with the next few examples. 


Example 7.6 
A first order system is represented in direct form HU in Example 7.2. The 
state-space description can be derived directly from Figure 7.2: 


, ay 1 ; 
ee nn 0 (7.69) 
ay ay 
a By ay 
Y= (4 —ao— }zt+—z. (7.70) 
OY Oy 
The matrices of the state-space description in this case have dimension 1 x 1: 
cg 1 a1 89 ~— Gor By ee 
wee Re. ie ee eee (7.71) 
Oy (aa OY ay 


Fyom here we obtain the same result with (7.65) and (7.66), that we obtained in 
(7.21) directly from the differential equation: 


? . ee : ; . 

ai Bo — aot Cg 1 fy 1 ai8o- oof) By 
H(s) = s+: -_—= — po 

ay Oy Qy my 4 ays+tag ey 

B16 + Bo 

48 + ap 

. mes 4 

0189 — ao: O A199 — Ao 

ais): = 10 oft f ,y 20 22 P00 OOP, 
OL Oy as + ag 
(7.72) 


Example 7.7 


The state-space description of a second-order system in direct, form HI (see 
Figure 7.3) is: 


: Oy a2 3, — 04 By 
RS ey tay tf (7.73) 
2 OQ 
: co 2289 — A /32 es 
20° S1 i x (7.74) 
ag (aD) 
i _ Be . 
y= —y +2. (7.75) 
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We write down the system matrices: 


Ree: cm | —ay Hs ae - | a9, ~ Bo | 


a2 | -ag 0 02 | aay — anBe 
(7.76) 
7 : ihe 
G34 pe”. 
a2 2 
With 
1 25+ A, —ae 
(sI—A) = — | (7.77) 
fa) OG as 
$24 1 28 ag 
(2 Aye = ; | ‘ (7.78) 
M8" + A185 + AO ~Op Ags+ay 


and (7.65) the system function follows after some rearrangements. G(s) is then 
obtained as 


1 
G(s) = ——————_-|s 1 7.79 
(s) 28? + as +a al ( ) 
and with (7.64) follows the result in (7.58). 
& 


For systems of any degree, the determinant of (sf — A) becomes the denomi- 
nator polynomial of H(s) and G(s). 


7.3.2 Determining the Initial State from the Initial Values 


The equations (7.64) to (7.66) generate a concise formulation of the input-output 
relationship for systems of any degree in a general state-space structure. If a 
direct form IT or UI state-space desription is chosen, however, only to benefit, from 
the advantages of matrix notation, the initial state z(0) is not available. It is 
necessary therefore, to find the connection between the initial state and initial 
values for systems of all degrees. 

In order to do so, we also use the advantages of the state-space description. 
From the output equation(2.34) in the time-domain, we find through differentiation 
and use of the state equations (2.33) at t = 0: 


y(O) = C2(0) + Dzx(0) 
y(0) = CAz(0) + CBa2(0) + Dé(0) 


g(0) = CA?z(0) + CABz(0) + CBa#(0) +D2(0) 
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After the N — 1 derivatives of y{t) at t = 0 have been calculated. the results are 
surmmarised in matrix form 


y(0) = Wa(0) + Vx(0) (7.80) 
with the vectors 
a(0) y(0) 
£(0) y(0) 
x(0) = #(0) — y(oy=} 9) (7.81) 
gh N~ (0) a (0) 
and the matrices 
Cc D 0 0 She 0 
CA CB DB 0 beg 
Ww - CA? e WAGs CAB CB D .. O 
CAN! CA*"B CA 3B CA-4B D 
(7.82) 


Now the initial state can be expressed by the vector of the initial values y(0) and 
x(0): 


2(0) = W-"[y(0) — Vx(0)]. 


(7.83) 


With (7.64) follows for the output of an LTLsystem described by an Nth-order 
differential equation like (2.3), with given initial conditions y(0) to y“%~) (0), and 
the input signal x(t): 


| ¥(s) = H(s)X(s) + G(s) W~tly(0) — Vx). | (7.84) 


Example 7.8 


As an illustration, we continue Example 7.7. The matrices W and V are in 
this case 


l 1 0) ee fn 18 . 
w= — ay , Worse (7.85) 
a) -— 1 ay as 
(aD) 
= | op pl ay | c28 cabs a (7.86) 
OQ 


By substitution, we obtain the result (7.52), which has been shown before only for 
a second order system. Here, it follows as a special case of an Nth-order system. 
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7.3.4 Determining the Internal Part in the Time-Domain 


So far we have learnt two methods to determine the output signal of an LTT 
system with a known right-sided input signal and known initial values: the clas- 
sical method with a general homogenous and particular non-homogenous solution 
(Section 7.1.1). and system analysis using the Laplace transform (Section 7.1.2). 
We will now examine a third possiblity. that falls somewhere between the other two 
methods. It can be seen as a special case of the solution using the Laplace trans- 
form and is particularly simple to use. if a system has been given as a differential 
equation and initial conditions at t = 0: 


N N 


—~ dy dx 
acy 3 Ex 7.87 
de Ge = Lib gE = 
gael k=0 
y? (0) =< Yi q = (), { i decuriene N os { ‘ 


If the numerical values of the coefficients of the differential equation are given, 
then this method is generally the quickest solution. It starts by separating the 
solution into the external and internal parts 


¥ (s) = H(s)X(s) + G(s)z(0) . (7.88) 
eomemen yom? Net yeommce” 


Yext (5) Yint (8) 
As before, the external part is the inverse Laplace transform of H(s)X(s) 
Yout($) = H(s)X(s) . (7.89) 
To determine the internal part 
Yine(s) = G(s)z(0) = G(s)W>t{[y(0) — Ve(0)] (7.90) 
we have so far had to start with a defined systern structure and 


@ either choose the initial states z(0) so that they are compatible with initial 
values y(0), 


e or additionally to G(s), determine matrices W~! and V. 


Both possiblities are cumbersorae for higher-order systems, if the system model 
only consists of a differential equation (7.87) and initial values (see (7.52) for a 
second-order system). In order to avoid this. we combine the advantages of the 
Laplace transform: with the simplicity of the classical homogeneous solution (7.5) 
in Section 7.1.1. 

At first, we note that the order of the numerator of the transfer function G(s) 
exceeds the order of the denominator by at least one. That can be illustrated in 
two ways. 
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e The inverse matrix (sI — A)~' can also be expressed as the adjunct matrix 
adj(sl — A) and the determinant det(sI — A) 


__ adj(st — A) 7 ¢ 
; A fists SS ieeeeeciae ; 7.91 
oe )" ~ det(sl ~- A) ) 


The adjunct matrix contains the determinants of matrices that are formed 
from (sI — A) by deleting one row and one column. For a system of order 
N. the highest degree of numerator polynomial in s that can arise is N — 1. 


e G(s) describes the internal feedback of the state in the systern through the 
integrators and matrix A. This feedback cannot go along any path that 
does not contain an integrator with the transfer function = The order of 
the numerator must therefore be less than the order of the Hetoninatoe, 

From the representation of (sI - .A)~+ it is evident from (7.91) that G(s) and 


H(s) both have the same denominator polynomial, det(sI — A), in fact. We can 
therefore represent the internal part by partial fractions: 


N 
= G(s = 7.9% 
Yint (8) = G(s)z(0) oe a (7.92) 
tez] 
The poles s, are equal to the poles of the system function 
. A(s ; 
H(s) = (s) (7.93) 


Bis) 
with the denominator polynomial B(s) = det(sI ~- A). The partial fraction ex- 
pansion in (7.92) only accounts for single poles for simplicity. The expansion for 
multiple poles has to be calculated according to (5.64). 

In contrast to before, we will not determine the partial fraction coefficients A, 
and with them the numerator polynomial of G(s)x(0) from the initial conditions 
in a more or less complicated way in the frequency domain. Instead, we determine 
the internal part in the time domain and obtain immediately from (7.92). 


thine (t) = Sy Ae, £>0. (7.94) 


a=] 


This defines the internal part in a general form, but we still do not have the partial 
fraction coefficients A,. So we take the first N —1 derivatives of the desired solution 


y(t) os Yess (t) + Yin (E) 
y(t) cad Bex (t) + Mint (E) 


a(t) = Hens (t) + ine (t) (7.95) 


ee N ; i : 
ype = yk Dy + y(n (t). 
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Here the external part Yext(t) = £7'{H(s)X(s)} is already known and so are its 
derivatives. The internal part is given by (7.94), or another corresponding form 


in the case of multiple poles. For simple poles, the derivatives of the internal part 
are 
iN 


yin (t) = > Aste, t> 0. (7.96) 


In the solution y(t) and its eran we only know the initial values y;, i = 
1....,N att = 0. That is sufficient, however, to set up a system of linear equations 
for the partial fraction coefficients A, from (7.95) 


i 1 paren 1 A Yo a> Yost (0) 
a 3 | ) 
8y 89 oe SN yo Yext (0) 
2 2 2 Ag . 
ai BS. aes. 185 = Y2 — Yext (0) _ (7.97) 
NE _ : AN N= 
go a ee Be yn—1 — ye) (0) 


After solving these equations by standard methods, we obtain the solution for the 
output signal in the form 


y(t) = yore (t) + gine (t) = £71{H(s)X(e)} + Ase e +02 (7.98) 


al. 


The advantage of determining the internal part in the time-domain is that we 
only need the information that is provided directly by the problem, in the form 
of (7.87). 

e The system function H(s) can be obtained directly from the differeritial 

equation (see Chapter 6.4). 


e The external part is given by the inverse Laplace transform of the sys- 
tem function and the Laplace transform of the input signal ye(t) = 
£°'{H(s)X(s)}. The inverse transform can be carried out using the partial 

5 action form. 


e A general form of the internal part with unknown factors can be obtained 
from the denominator polynomial by partial fraction analysis and inverse 
Laplace tranformation. 


e The unknown factors are determined so that the solution fulfills the initial 
conditions set in (7.87). 


Most. of the effort required to carry out this procedure is in the formation of 
the derivatives of the external part Yex:(t) and in the solution of the equation 
system. Both are relatively easy to carry out, if numerical values are given for the 
coefficients of the differential equation. 
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Example 7.9 


We are looking for the output signal y(t) of a first-order system for 1 > 0, for 
a given input signal x(¢): 


ytOly=x. y(0) = 8, r(ij)=10.1siné, §>0. (7.99) 


The system function is 


H(s) = ——— Re{s} > —0.1. (7.100) 


10.1 ; 
x(t) = 10.1sint - e(t) oe X(s) = ad Re{s} > 0 (7.101) 
by splitting X(s)A(s) into partial fractions: 
10.1 A Bs+C 


Vou(s)=X(s)H (8) = 5 a 


: : 102 
GEG nOly oeOl aed a) 


The coefficients are obtained either as in Example 7.5, or by equating coefficients 


C = 1. Inverse transformation yields the external part: 


eae a. 10108 1 
a = a esi * el 
: : 6 ° (7.103) 
Oo ie} oO 
Yoxt(t) = WeO!@ — 10cost + sint , t>0. 


The general form of the internal part is obtained from the denominator of the 
system function: 


Yine(8) = 5 eo =¥n(t)=aeO*, t>0. (7.104) 


The complete solution is the sum of both parts: 
y(t} = Yext(t) + yine(t) = (10 + a)e?™ ~ 10cost+sint, t>0. (7.105) 


if fulfills the differential equation and the initial conditions for a = 8. The Fig- 
ures 7.7, 7.8 and 7.9 show the internal part, the external part and the complete 
solution. 
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Figure 7.9: Complete solution of Example 7.9 


7.4 Assessment of the Procedures for Solving Ini- 
tial Condition Problems 


We now know three procedures for dealing with LT-systems with right-sided input 
signals and known initial conditions: 


1. the classical solution of initial condition problems in the time-domain (Sec- 
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tion 7.1.1). 


2. system analysis with the Laplace transform completely in the frequency- 
domain (Sections 7.1.4, 7.2, 7.3.1, 7.3.2), 


3. system analysis with the Laplace transform in the frequency-domain and 
calculation of the internal part in the time-domain (Section 7.3.3). 


The classical solution is certainly the most complicated method in terms of calcu- 
lation effort, as it works exclusively in the time-domain. It is difficult to guess a 
particular solution for higher-order systems. If the Laplace transform is used to 
find the particular solution, the classical solution turns into the third procedure. 

System analysis with the Laplace transform completely in the frequency- 
domain is the most suitable procedure if the internal structure of the system 
is known, for example, an electrical or state-space representation. Then the in- 
ternal part can be determined cither from the initial state or the initial valucs. 
The transfer function G(s) and matrices V and W are obtained directly from the 
state-space representation. 

Calculation of the internal part in the time-domain is suitable if the internal 
structure is unknown, and only the differential equation and the initial conditions 
have been given. The necessary calculation steps are simple to carry out, if the 
numerical values of the differential equation coefficients have been provided. 


7.5 Exercises 


Exercise 7.1 


A causal system with transfer function H(s) = has the input signal «(t) = 


_ s+1 
— sin(wot) e(-t) + te~* e(t). At t — —oc the energy stores in the system have 
been empty. 


a) Explain why only the external part and can determined in this case. and not 
the internal part. 


b) Give the response y(t) of the system. 
Exercise 7.2 
Solve the initial condition problem 
y(t) + 8y(t) = x(t), t>0 
a(t) = 10 cas(4t). t>0 
y(O+) = Yo 


with the ‘classical method’. Determine 
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a) the homogenous solution yp (t) 
b) a particular solution y,(t) 
c) the complete solution y(t). 
Indicate the internal and external parts of the solution. 
Exercise 7.3 
Solve the initial condition problem 
y(t) + 3y(t) = a(t), t>0 
x(t) = 10 cos(4t), t>0 
y(0+) = Yo 


with the Laplace transform. Consider the initial conditions using the differentia- 
tion theorem for the unilateral Laplace transform (4.34). as shown in Section 7.1.2. 


Determine 

a) H(s) 

b) Y(s) 

c) y(t) for t > 0 
Exercise 7.4 


Derive equation (7.16) from (7.15) using the differentiation theorem of the Laplace 
trransform (4.34). 


Exercise 7.5 


The following first-order system is given as a block diagram: 


x(t) [4] y(t) 


2(0) ae | 


Determine 


a) the initial values y(Q—) and y(0+). 


> 
f 


7.5. Exercises 161 


b) the output signal y(t). 


Exercise 7.6 


The following second-order system is given in direct form IIL 


z(t) = e(t) — e(t—2) 
zy (0) = 2a 
a2 (0) = 2b 


a) Determine y(t) with (7.58). 


b) Can (7.58) also be used, if the block diagram is also given in direct form IT? 
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8 Convolution and Impulse 
Response 


8.1 Motivation 


In Chapter 6 we gave the fundamental relationship 


[¥(s) = H(s)X(s) (8.1) 


in accordance with (6.5) between the input and output signals of an LTT-system. 
The system function H(s) and the transform of the input signals X(s) stand 
adjacent as Laplace transforms. They are even interchangeable. With our current 
knowledge, however, these seem to be two completely different kinds of functions. 
X(s) is the Laplace transform of a function of time and can be determined from 
the input signal (see (4.1)): X(s) = L{ax(t)}, but the system function H(s) is 
obtained. in contrast, from the given system modcl in the form of a differential 
equation, an electrical network or another form of notation. In spite of this obvious 
difference. however, H(s) and X(s) can take the same form. as we will show in 
two short examples. 


Example 8.1 


The function of time 
a(t) =ae“e(t), aeIR, a>O 


has (see Example 4.1 or Table 4.1) the Laplace transform 


X(s) = L{x(t)} = ——. (8.2) 


Example 8.2 


The RC-network from Figure 8.1 has transfer function 
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1 1 
Y(s) rai T a 1 1 
(s) X(s) R+ i Boe 1 sta a ee ee) 
sc T 


Clearly the Laplace transform of the signal a(t) = ae~’e(t) and the system 
function of the RC-circuit have the same form. This leads us to assume that 
relationships exist here that we have not yet discovered. In order to shed some 
light on these relationships, we will first ask some questions. 


1. Can the system function H(s) be assigned a function of time h(t), such that 


H(s) = L{h(t)}? 


2. Is it possible to excite a system with a particular input signal that produces 
the time function h(t) as the output signal? What would this special input 
signal look like? 


3. Can a system with system function H(s) also be uniquely identified by the 
corresponding function of time h(t) if it exists’? What does the function h(t) 
say about a system? 


4, Is there an equivalent relationship to Y(s) = H(s)X(s) in the time-domain, 
between y(t), x(t) and h(t)? 


We will answer these questions in the following sections. 


8.2 Time Behaviour of an RC-Circuit 


8.2.1 System Function 


To approach the answers to the above questions, we consider in this section the 
RC-circuit from Figure 8.1, with the system function H(s) given in (8.3). First of 
all we use the inverse Laplace transform on the system function H(s) and obtain 
the inverse of (8.2) 


A(t) = £-'{H(s)} = £7" ise} = ae e(t) . (8.4) 


Figure 8.2 shows the time behaviour. 

By inverse transforming the system function H(s), we have assigned it a func- 
tion of tire h(t), although we do not actually know what it means. ‘Taking a 
right-sided function for h(t) is at this time arbitrary as we have not yet specified 
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Figure 8.2: Time behaviour of the function h(é) from equation (8.4) (a = 7) 


a region of convergence, but we will give a justification for this choice later, for 
physical reasons. All the same, we can now answer question 1] in Section 8.1, with 
yes. 


8.2.2 Response to a Rectangular Impulse 


To explain the meaning of the function h(t), we evaluate the response of the RC- 
circuit to a rectangular impulse x(t) shown in Figure 8.3. The function of time 
and its Laplace transform are 


1 
— fordO<i< T 1 : 

x(t)= 2 To " oe X(s)= a (1-e™) (8.5) 
) otherwise vat 


Figure 8.3: Rectangular impulse 
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From the methods in Chapter 6 we obtain the Laplace transform of the output 
signal ¥Y(s) 


a il 1 {t L : 
¥ (es) =H (e)X (5) = —— — (te) = Sa ee eee ee 
) ee) Sai ) Tg |S sta ae) ee) 
and from the inverse Laplace transform, we obtain the output signal y(t) itself 
1 1 - 
yt) = = [t-e™le@)- = [2 ~~ or) e(t - Ty) = 
ve l | (t) Ts e ( 0) 
1 4 
= [be] Dea rae Py 
i 
= La hee Gi BS (8.7) 
we NelOrt 1 pot fT T <¢t 7 
Th le € ost 
0 otherwise 


Figure 8.4 shows the behaviour of y(t) for a certain value To. 


Ty To +T t 


Figure 8.4: Response of the RC-circuit to a rectangular impulse 


8.2.3 Response to a Very Short Rectangular Impulse 


We now vary the width of the rectangular impulse at the input and investigate 
the effects on the output signal. Figure 8.5 shows various rectangle impulses x,;(¢), 
a= 1,2,3.4 from (8.5) for the values Ty = 1; 0.5; 0.2; 0.05. As the height of the 
rectangle is the reciprocal of the width, all of the impulses have unit area. 

‘The corresponding output signals y;(¢), 7 = 1.2.3.4 are shown in Figure 8.6, It 
seems as though for smaller and smaller values of Ty, y(t) becomes more and more 
similar to the form of h(t) shown in Figure 8.2. In fact, the first term (0 < t < Tp) 
becomes shorter, and the form of y(t) becomes mainly defined by the second term 
(Ty <4). With the limit 7p — 0, 

oT 


l 
¢ — ivy: ear een PO oat t = dy ~at t = h t . 8.8 
Nr ee ee ee) (8.8) 
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Figure 8.5: Various rectangular impulses with unit area 


4 
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“i y3(t) 
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Figure 8.6: Response of the RC-circuit to different rectangle impulses 


Before we answer the second question in Section 8.1 with yes. we need some 
insight into the nature of the input signal x(t), that produces the response y(t) = 


h(t). 


8.3 The Delta Impulse 


8.3.1 Introduction 


In order to determine the input signal x(t) that leads to the output signal y(t) = 
h(t), we will try to use the limit Ty — 0 directly on the rectangular impulse a(t) 
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from (8.5). The result is called the delta impulse 6(t) 


jim ay Soe (8.9) 
{t is also known as the Dirac delta function, Dirac umpulse and wnat umpulse. 
The delta impulse d(¢) is not a function in the usual sense. Attempting to 
define 6(t) by a rule that assigns a value d(t) to every time point ¢ leads to a 
function that takes the value zero for t 4 0 and grows beyond all limits at £ = 0. 
The casual formulation 


5(t) = (8.10) 


O for t40 

co for t=0 
although not wrong, is of little use as it does not explain how 6(é) can be mathe- 
matically combined with other functions. 

A mathematically precise definition of the delta impulse as a reliable function 
for which every value of an independent variable is assigned a function value is 
not possible. [t is necessary to use the idea of distributzons instead [17, 19]. We 
will refrain from a mathematically thorough formulation of the delta impulse and 
related distributions, and instead we will illustrate some important properties 
that will be useful when dealing with signals and systems. The delta impulse 
will be dealt with using the analogy of infinitely thin and infinitely high rectangle 
impulses. 


8.3.2 Selective Property 


The principle for use of the delta impulse and other distributions is that they 
are not described by their undetermineable properties, rather by their effects on 
other functions. Instead of describing the delta impulse by an assignment (for 
instance (8.10)), we see whether the value of the integral 


ox 


i fH) d, 
~oo 
describes the effect of the delta impulse on the function f(t). First we abandon 


the delta impulse in favour of the rectangle impulse x(t) from (8.5). evaluate the 
integral and carry out the limit Ty > 0. With (8.5), 


To cp. CE = 
| f (é)a:(t) dt = 7 [10 dt = ae a : (8.11) 
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where F(t) is an antiderivative of f(1) (F'(t) = f(4)). The limit Zo — 0 leads to 
the differential quotient of F(t) at t = 0 and yields 


‘an _ FCRY=FO} 24 = 
j ava #4 = lim ———— = F(t = f(O). 8.12 
Aho / SES at eee es 
With (8.9) we obtain 
/ f(4)d(t) dt = f(0) . (8.13) 


This relationship describes the selechve property of the delta impulse. It means 
that. the integral of the product of a function and the delta impulse removes all 
function values f(t) for t 4 0. and selects the value f(0). Note that f(¢) must be 
continuous at t= 0. 

Figure 8.7 describes this situation. The delta impulse is represented by an 
arrow pointing upwards at t = 0. It means that d(t) disappears for t # 0 and 
grows beyond all limits at ¢ = 0 (compare with (8.10)). 


Figure 8.7: Selection of the function value f(0) 


If f(t) =1 Vt, we know immediately from the selective property (8.13) that 


ox 


| d(t)df=1. (8.14) 


OG 
\ 


This result is clear if the delta impulse is imagined to be the limit value of a unit 
area rectangle. We also say that the delta impulse has an area or better. a wezght 
of one. 

The delta impulse is not restricted to selecting a value at t = 0, in fact, it 
can be used to select any point. In the same way as in equations (8.11) to (8.13) 
follows 


i F(t)O(L — ty) dt = flto) . (8.15) 
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This general form of the selective property is shown in Figure 8.8. 


O(t-tp) 
fit) 
1 


Figure 8.8: Selection of the function value f(to) 


The selection property is the most important part of the definition of the delta 
impulse in distribution theory. With its help we can show all of the important 
properties of the delta impulse. 


8.3.3 Impulse Response 


Before considering further properties of the delta impulse. we will summarise the 
results obtained so far. They allow us to answer the second question in Section 8.1: 
it 2s possible to cause the RC-circuit depicted in Figure 8.1 to produce the function 
A(t) at the output. The input signal that does this is the delta impulse 6(é). h(t) 
is therefore called the impulse response to the RC-circuit. 

The function h(t) = £°!{H(s)} that was previously anonymous, is slowly re- 
vealing itself to be a powerful tool in identifying systems, but to further investigate 
its properties we need more information about the delta impulse. 


8.3.4 Calculations with the Delta Impulse 


The following derivations of calulation rules for the delta impulse depend on two 
principles. 


e The delta impulse can only be dealt with when it is within an integral. Its 
properties can be expressed in terms of the effects of the selective property 
on other funetions of time. 


e Calculations with the delta impulse must be consistent with the calulation 
rules for ordinary functions. 


We will investigate the properties of delta impulses using these two principles. 
Another possiblity would be using rectangle functions of width 7 and the limit 
Ty — 0, as we did when deriving the selective property(see (8.11) to (8.13)). Using 
this limit is cumbersome, however, so we will stick with the elegance of the selective 
property. 
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8.3.4.1 Linear Combination of Delta Impulses 

The most elementary property of delta impulses is their behaviour when added and 
multiplied with factors, i.e., in expressions of the form ad(t)+6d(t). The properties 
of these linear combinations can be investigated using the selective property 


| [ad(t) + bé(t)f(t)dt = a | S(t) f (t)dt +b | S(t) f (tat 
7 = af(0) + bf (0) = (a +2)/(0). (8.16) 


‘The linear combination ad(L) + 6d(¢) has the same effect on a function f(t) as an 
individual delta impulse (a + 6)d(4) with weight (a + b). Therefore 


ad(t) + 65(t) = (a+ p)a(0) «| (8.17) 


8.3.4.2 Scaling the Time-Axis 


Scaling the time-axis occurs when the unit of time is changed or with normalisa- 
tion. It may seem that the delta impulse is not affected by such operations as it 
is zero except at t = 0. Attempting to derive the properties of the delta impulse 
from its degenerate time behaviour is deceptive, however, as we will show in the 
following investigation using the selective property. 

To explain the properties of a delta impulse with the argument at, we start 
with (8.13) and with the substitution «= at, a € IR, we obtain 


if S(at) f(t)dt = ia [os (<) ee qf (8.18) 


‘Taking the magnitude of a is necessary, which is clear if the substitution <= at is 
carried out with different signs of a. 

The delta impulse 6(at) has the same effect on the function f(t) as a delta 
impulse a7 0( t) with weight ral Therefore, 


1 
lis 


; | 
100 = —6(t). | (8.19) 


Delta impulses with weighting factors are depicted as a vertical arrow showing the 
corresponding weight. The scaled delta impulse from (8.19) has the representation 
shown in Figure 8.9. 

From (8.19) it is immediately yielded when a = ~—1, that the delta impulse is 
even, so 


(8.20) 
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Figure 8.9: Scaled delta impulse 


8.3.4.3 Multiplication with a Continuous Function 


From the selective property, 


i f(t)s(t)dt = | f(O)S(t)dt = f(0) . (8.21) 


OC 


As all values of f(t) at t 4 0 are removed, multiplying a function by a delta impulse 
corresponds to weighting the delta impulse with the function value at ¢ = 0. 


FAH) = F(0)4(t) (8.22) 


This statement is only true ~ just like selective property (8.13) — for functions f(t) 
that are continuous at ¢ = 0. In particular, the product of two delta impulses 
6(t) - 6(¢) is not permitted. 


8.3.4.4 Derivation 


The investigation of the delta impulse with the selective property can be expanded 
to other properties, for example, forming a derivative. Differentiation of d(t) by 
forming the differential quotient is of course not possible, as the delta impulse 
cannot be differentiated. Despite this, a comparable operation can, in fact, be 
used on distributions. To distinguish this from differentiating ordinary functions, 
however, the term derivateon is used. 

The derivative of the delta impulse has the same notation as the symbol for 
a derivative with respect to time, written 4 (t). To explain what should be un- 
derstood by this, we will again use the selective property. Under the integral, the 
derivative of 6(t) can be transformed using partial integration of the corresponding 
continuous function, and the selective property of the undefined funetion d(¢) can 
be represented by the effect of a delta impulse (2). 

oO OO 


| A(t) f(t)dt = KIO) = / A(t) f(t)dt = —f (0). (8.23) 


areca! oO 
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As the term 6(£)f(¢) disappears for t + too, only the negative derivative of f(t) 
att = 0 remains. We can interpret the derivative 4(t) as a distribution that forms 
the value of the derivative —f (0) from a function f(t), using the selective property. 
The derivation of d(t) is revealed by its effect on the continuous function f(t). 

Unfortunately we cannot use rectangle functions with a limit to illustrate A(t), 
as they are not differentiable, but we could, however, have introduced the delta 
impulse as another impulse function with a limit. We only chose the rectangle 
function because it was particularly simple to integrate (8.11). 

The corresponding limit for a bell-shaped impulse function d(£) with charac- 
teristic width T is illustrated in Figure 8.10 (top). In contrast to the rectangle 
function, the derivative d(t) of the bell-shaped function can be formed. The limit 
for T -+ 0 then leads to the derivative 4(t) of 6(£) shown in Figure 8.10 (below). 
Becatise of the double impulse upwards and downwards it is also called a dou- 
blette [19]. It should also be emphasised here that the graphical representaion 
with arrows on the right-hand side of Fig 8.10 is for illustrative purposes only. An 
exact description of distributions is only possible using their effects on ordinary 
functions (see (8.13) and (8.23)). 


d(t) 5) 
lim d(t) 
T T> 0 
t ef 
| d(t) oft) 
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Figure 8.10: Graphical illustration of 5(¢) 
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Higher derivatives of 6()(t) can also be introduced in the same way as A(t). 
They form the nth derivative of a function f(t) at the point t = 0 (with a change 
of signs where appropriate) 


CO 


/ 5 (4) f(t) dt = (—1)" f™ (0). (8.24) 


oO 
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By choosing certain functions f(t), different relationships between the delta im- 
pulse 6(4) and its derivatives can be obtained, For example, from (8.23) we let 
f(t) = —t, and equating the integrands we obtain the interesting relation 


| 454) = d(t) | (8.25) 


As 4(t) is an even distribution and —t is an odd function, d(t) must be odd: 


inte 


Of course, we could have guessed that this was the case from Figure 8.10. 


(8.26) 


8.3.4.5 Integration 
We will consider integration of the delta impulse as the inverse of derivation 


OO 


[oo \dr= fs (cje(t— cdr. (8.27) 


The inclusion of the step function ¢(t) makes it possible to form the integral with- 
out a variable upper limit. The integrals appearing within the selective property 
can be interchanged, and then. 


f 


cdr] fit)d c= | | Hoe 0 cde f(t) dt = (8.28) 


_ * na shpat te | Habito | Hehe 


The same effect on a function f(t) can be achieved with the step function ¢(f). 
however. 


7 e(t)f(t)dt = : pleat. (8.29) 
~—OO 0 


We can therefore identify the integral over the delta impulse 6(¢) as the step 
function é(t) 


(8.30) 
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Reversed. the delta impulse is the derivative of the step function 


| é(t) = 6(t). | (8.31) 


Figure 8.11 shows the relationship between the delta impulse and the step function. 


Delta impulse 6(t) Step function «(t) 
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Figure 8.11: Della impulse and step function 


8.3.5 Using Delta Impulses 


The calculation rules we have just learnt show that the delta impulse can be dealt 
with almost like an ordinary function. With this extended repertoire of functions, 
many problems can be solved more elegantly, where before. it was cumbersome 
using exclusively ordinary functions. We will examine two such examples. 
_ Example 8.3 

Figure 8.12 shows a signal a(t) (top left), that cannot be differentiated because 
it is discontinuous at one paint. Forming a derivative in the normal way is not 
possible. If the right-sided and left-sided limits of the differential quotient (not 
the function itself!) are equal at the point of discontinuity, the signal x(t) can, 
however, be represented as the sum of a function that can be differentiated and 
the step function (Figure 8.12 top right). The step height @ corresponds to the 
difference at the discontinuity. With differentiation of the continuous part and 
derivation of the step function, the derivative of the continuous part and a delta 
impulse with weight a is obtained (Figure 8.12 bottom right). Both terms can 
be put together to give the derivation of the discontinuous signal, which has no 
derivative in the normal sense. The discontinuity with step height @ appears in 
the derivation as a delta impulse with weight a (Figure 8.12 bottem left). 
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x(t) a &(t-T) 
t ae | 
| 
; if bs | 
signal with discontinuity ——_—_» sum of two functions that can be 


differentiated 


(a) 
- f fmm : a 


Figure 8.12: Analysing signals with discontinuities 


————~——-=_-- Wixample 8.4 


‘The equation for the motion of a puck that slides on a frictionless surface comes 
directly from the formula Force = Mass x Acceleration: 


+ 1 pe 
u(t) = ett) ; (8.32) 


where :c(t) is the force on the puck, m is its mass and y(t) is its displacement (see 
Figure 8.13). Both force and displacement are independent quantities. 


force x(t) 


displacement y(t) 
Figure 8.13: A puck sliding on ice 


if the puck is uniformly set in motion at t = 0 by an ice hockey stick, the 
displacement increases proportionally with time (Figure 8.14 top). The force could 
be found by differentiating the displacement twice, if y(t) could be differentiated. 
Because of the step at t = 0, however, this is not the case, and again we need 
the help of distributions. Derivation of the displacement yields the velocity in the 
form of a step function. Repeating the derivation then yields force in the form of 
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a delta impulse. The delta impulse here is the idealized strike of the puck with 
the hockey stick. 


observed displacement 


yi) 
0) for $< 0 
y(t) = { vot for b> 0 
am t 
velocity 
y(t) 
0% g(t) = voe(t) 
‘ pe f 
force x(t) 
M Vg a(t) = mi(t) = mvp d(t) 
te f 


Figure 8.14: Displacement. velocity and applied force of a struck puck 


8.4 Convolution 


After we have got to know the delta impulse in detail, we will return to answer 
the remaining questions in Section 8.1. The impulse response briefly introduced 
in Section 8.3 will play an important part in this. 


8.4.1 Describing Systems with the Impulse Response 


In Chaptcr 3 we were intcrested for the first time in describing the transfer prop- 
erties of LTI-systems. We could show only using the definitions of linearity and 
time-invariance that fimctions of the form e* are eigenfunctions of LT'L-systems. 
This leads directly to the system function as a system model of LTT-systems in 
the frequency-domain. 
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After we identified the function of time h(t) = £~'{H(s)} as another system 
description and interpreted it as the system response to a delta impulse, we now 
derive an equivalent relationship to (8.1) in the time-domain. To do this we only 
need to use 


@ the impulse response h(t) of an LT I-system, 
® the selective property of the delta impulse, 
e the definitions of linearity and time-invariance. 


The result is then general and does not only apply to the network considered in 
Section 8.2 as an introduction. 


We will start with an LTI-system with a known impulse response A(t) and we 
want to show 


e that the impulse response A(t) is sufficient to describe the system’s reaction 
to any input signal, 


# how the relationship between the inputs signal and output signal looks in 
the time-domain. 


First of all we describe the LTL-system with its reaction to an input signal 


y(t) = S{o(e)}. (8.33) 
In particular, the reaction to a delta impulse is 
h(t) = S{d(t)}. (8.34) 


Then we use the selective property (8.15), combined with (8.20) to express the 
input signal as a function of itself 


mth | cir — cide (8.35) 

With (8.33) we find the output signal 
yl) = S | alcjd(t— cjdc> . (8.36) 

OS 


In the integral only 6(é — 7) depends on ft: the values 2(z) are in terms of ¢ only 
weighting factors. Because of the linearity of the system 
y(t) = | a(c)S{d(t - z)}de. (8.37) 


—OO 
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Finally, from the time-invariance and (8.34), 
y(t) = | a(cja(t ~ cde. (8.38) 


This is our goal. as (8.38) shows that only knowledge of the impulse response of 
an LTI-system is needed to find its reaction to any input signal «x(¢). 

The combination of two functions of time f(t) and g(t) (8.38) is called convo- 
luteon and is denoted by *. 


xO 


| f(dglt— dar = fl) «9(0) 


~ Ox 


With the substitution ¢ = ¢— 7 it is easy to show that convolution is commutative 


F(t) * g(t) = g(t) « f(t) . 


8.4.2 Impulse Response and System Function 


The answer to question 4 in Section 8.1 is now clear: just as the transform of 
the output signal Y(s) can be obtained in the frequency-domain by multiplying 
the transform of the input signal X(s) with the system function [(s), the output 
signal in the time-domain is given by the convolution of the input signal with the 
impulse response. 


X(s) —| 


Figure 8.15: A system in the frequency-domain 


Y¥(s) = H(s)-X(s) 


Figures 8.15 and 8.16 show how multiplication with the system function in the 
frequency-domain and convolution with the impulse response in the time-domain 
are equivalent. The connection can also be formally expressed. The relation we 
already know in the frequency domain follows from the convolution relation 


OO 


y(t) = h(t) salt) = | h(t — c)a(c)de (8.39) 
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a(t) ——»| h(t) ;— y(t) a A(t — c)a(z) de 


Figure 8.16: A system in the timc-domain 


using the Laplace transform, swapping the integrals and collecting together the 


Lerms. 
ie i A(t — z)a(z)d re =st , 
7 i fom u(t — ce dta(r) de 


Eo i H(s\e"*"a(c) dc = = Hn(s) e a(t) dt = H(s)- X(s) 
(8.40) 


Liy(t)} 


lI 


We have now shown the convolution theorem of the Laplace transform: 


o-e H(s)X(s), s€ ROC{h*a} D ROC{z}n ROC{h} . 
: (8.41) 
It is not ouly true when A(t) is an impulse response and a(t) is an input signal, 
but also generally for all pairs of functions of time whose Laplace transforms exist. 
The region of convergence of the convolution product ROC{h * a} is the in- 
tersection between the regions of convergence ROC{a} and ROC{h}. These two 
regions of convergence must overlap for the Laplace transform of the convolution 
product to exist. In (8.40) we had set out the condition that the complex frequency 
variable s can only take values for which both X(s) and A(s) exist. The region 
of convergence ROC{h * x} can, however, actually be larger than the intersection 
of ROC{x} and ROC{A} if, for example, poles are cancelled out by zeros. Often 
when £{h(t) * x(t)} does not exist, it means that the convolution product (8.38) 
does not exist itself. Expression (8.38) is indeed an improper integral that only 
converges under certain conditions. 
The ROC{h} of the system function H(s) that we have so far not paid much 
attention to, can be derived from the connection between the system function and 
impulse response 


H(s) = L{A(t)}. (8.42) 
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The normal rules governing the region of the Laplace transform apply in this case, 
and as they are all given in Chapter 4.5.3 we will not repeat them here. 

An interesting consequence can be obtained from the convolution theo- 
rem (8.41), if a delta impulse is input as x(f). 


A(t) « S(t)o—e HT (s\LLA(t}} (8.43) 


As A(t) * 6(t) = R(t), however, 
| L{6(t)} = 1. | (8.44) 


This can be immediately confirmed with the selective property 
C{5(t)} = / (tet dt=1, ROCHE, (8.45) 
ae 
The region of convergence encloses the entire complex plane, as the delta impulse 
is a signal of finite duration. 
Just as the number 1 is the unity element of multiplication. the delta impulse 
is the unity element of convolution. Figure 8.17 illustrates this. 


x(t) = d(t) —»| A(t) — y(t) = d(t) * h(L) = Aft) 


X(s)=1  —*=| Hs) pp» ¥(s)=1-H(s) = H(s) 


Figure 8.17: LTI-system with a delta impulse as input function 


With the convolution theorem we can also easily confirm that e*' is the eigen- 
function of LTI-systems. In Chapter 3 we derived this property from the concepts 
of linearity and time-invariance. Convolution for a(t) = e* gives 


6OD 


y(t) = i A(z) &&!-] dr = e* | h(c)e 8 dr=e"*H(s), s€ROC{h}. 


OS FOO 
(8.46) 
The response to an exponential function is likewise an exponential function. mul- 
tiplied by the system function H(s). The convolution integral clearly converges 
when the complex frequency s of the the input signal «(t) lies in the region of 
convergence of the system function. 
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8.4.3 Calculating the Convolution Integral 


Calculation of the convolution integral (8.39) requires some practice. It is es- 
pecially important to make the distinction between the time variable ¢ and the 
integration variable z in (8.39). We will deal with this subtle but important dif- 
ference in detail, in a simple example where we will calculate the response of an 
RC-circuil to a rectangle impulse. In Section 8.2.2 this problem has already been 
solved in the frequency-domain and the result is shown in Figure 8.4. This time 
we will stay in the time-domain and use the convolution theorem. 

First we consider the function of time A(t) from Figure 8.2, which we already 
know represents the impulse response. In Figure 8.18 above, h(z) is plotted against 
the variable of integration ¢. To change it to the form A(t ~ cz) from (8.39), we 
first have to turn the right-sided function to the left (h(—c)) and shift it by ¢ 
(h(t— 7)). Figure 8.18 (middle) shows the result for various values of t. Note that 
t takes a fixed value while being integrated over z. The result y(¢) is dependent 
on ¢ because the convolution integral is calcwlated for many values of f. 


x(a), A{t-r) 


t<0 O<t ST) Toy <t 


Figure 8.18: The convolution integral 


The integrand A(t — c)a(c) is obtained by multiplication with x(7). The rect- 
angular form of 2(z) means that the integral can only have non-zero values for 
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e For t < 0 there is no overlap of A(t — zc) and a(z). The product h(t — c)x(r) 
and likewise the integral have the value zero. 


e For 0 <t < Tp h(t — rc) and x(r) partially overlap so the upper limit of the 
integral depends on t. The result is 


t t 
: 1 te Ed 
y(t) = | AG tl dt= x | po des 
0 0 
1 r 
; oe = i 
7 HT e t/t i ef/T dt= 
0 
Li o_eyr cal 1 2tfa 
= Sete etl == [re] | 8.47 
T° is (ee 0 ae eet) 


e For To < t, A(t — c) and z(z) overlap completely and the integration must 
be carried out between 0 and Zo. We obtain: 


} 1 1 -P 
y(t) = Mt-dode= = f pe "de = 
y(t) / ( lap mh | 
0 0 
3 ; 
od -t/T c/T = 
—é € dt 
lo T a 
0 
Li eye ctl” _ 1 nyt 1/7 
= = Tet! = = [eR/T 4] et, ¥ 
iT € € : T, € € (8.48) 
Summarised, the result of convolution is 
1 ye 1 ity ja 
fy ee E = 2/7) a nes ee aa t— Tp) = 
ut) = x [t-e**]eW)— x [1-« e(t ~ Ty) 
| .: 
A Die [4 O<1<T 
To iat 
= Tp R AQ 
A ee = 1| en t/t t= (8.49) 
To 
0 otherwise, 


as we obtained in the frequency-domain calculation in (8.7). Because of the three 
cases, evaluating the convolution integral in the time-domain is significantly more 
complicated even for the simple case considered here. 
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8.4.4 Impulse Response of Special Systems 


Now that we have investigated the relationship between the system function H(s) 
in the frequency-domain and the impulse response A(t) in the time-domain, we 
will consider the impulse responses of some special systems. 


8.4.4.1 Integrators 


First of all we would like to know about the properties of a system that has the 
step function e(t) as its impulse response. From the convolution of e{t) and z(t), 
we find that with (8.39) the output signal is 


y(t) = e(t) * a(t) = / e(t~ r)a(z)dz. (8.50) 
— OO 
Since 
jf i ceo nae i jf io oc<et 7 
e(r) = { 9 reg and e(t~ t) = { re (8.51) 


we can leave out the step function under the integral in (8.50) and instead only 
integrate over the values of ¢ for which e(t — 7) = 1, that is, between ~oo < rc <i. 
It should again be noted that for integration over z, the time ¢ should be seen as 
a fixed parameter. We obtain the system description 


t 


y(t) = e(t) « x(t) = di alzjdz. (8.52) 


9 


A system with the step response e{t) as impulse response therefore leads to an 
integration of the input signal, or in short: it is an integrator. 

This result was also found in Section 8.3.4.5, where we said that integrating 
a delta impulse yielded a step function. Figure 8.19 shows a block diagram of an 
integrator and also its response to a delta impulse at the input. The convolution 


5(t) —| ft ett) 


Figure 8.19: An integrator responds to a delta impulse with a step function. 


ot 
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theorem (8.41) for A(t) = e(t) is 


e(t) * x(t) o~-@ ~X(s), s € ROC D ROC{z} NM {s: Re{b} > 0}. 


This corresponds to the integration theorem for the Laplace transform (4.27). The 
transfer function of the integrator is 


A(s) = Lielt)} = - - Rew: (8.54) 


8.4.4.2 Differentiator 


In Section 8.3.4.4 we got to know d(t) as the derivative of the delta impulse with 
respect to time. We would therefore guess that 6(t) would be the impulse response 
for a differentiator. We can confirm that this is the case if we find the convolution 
of an input signal 2:(t) with the suggested impulse response: 


y(t) = 6(t) * a(t) = ei d(t ~ cja(c)de 


: (8.55) 
= i d(r — t)a(c)de = #(t) 


In (8.55) we used the selective property of a(t) (8.23) as well as the fact that we 
know 6(t) is odd (8.26). Convolution with the impulse response 6(¢) yields the 
derivative of a function with respect to time. 

The system function for a differentiator is 


H(s) = £L{d(#)} = i d(he'dt=s, 8 EC. (8.56) 


= 00: 


We can now re-write the diflerentiation theorem of the Laplace transform (4.26) 
directly as a special case of the convolution theorem (8.41): 


&(t) = d(t)* a(t) o—e sX(s). s€ ROC DROC{r}. (8.57) 


Interestingly enough we can also use (8.57) on signals with discontinuities or 
on distributions, if we interpret @(¢) as the derivation of x(t), which may contain 
steps, delta impulses and derivatives of delta impulses. We can then avoid having 
to deal with the initial value (0+) separately in the differentiation theorem for 
right-sided signals (4.34) or the step in the differentiation theorem (4.41). This is 
ilhistrated in the following example. 
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Example 8.5 


Here we will calculate the Laplace transform of the triangular impulse (Exam- 
ple 4.10) once more. First we form the second derivation of x(t). 


1 2 1 


z(t) = a(t) « d(t) aryec(t — 27) - ares) (ary 


i 


e(t + 27) 


i 


Omer. Cae 5(t— 27) — pei + oe —6(t + 27) 


The Laplace transform yields: 


; 1 Ast wean 1; 
32 y= 28st —2sT)\ __ fost _ gst)“ 
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The result é 
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is then immediately obtained, and it corresponds to (4.45). 


8.4.4.3 Delay Circuits 


A delay circuit is a system that reproduces the input signal at the output after a 
fixed time delay ty. Apart from the delay, the signal remains unchanged. Therefore 
the system response of a delay circuit to a delta impulse 6(f) must be a delta 
impulse delayed by tg (see Figure 8.20) 


A(t) = d(é — tg) . (8.58) 


h(t) 


lo 
Figure 8.20: Impulse response of a delay circuit 


That an LTIL-system with this impulse response also delays all other input 
signals by fo, follows from the selective property and convolution 


y(t) = S(t — to) * a(t) = / d(t — t—to)a( ct) de = x(t — to) . (8.59) 
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This relationship is depicted in Figure 8.21. 
The system function 


A(s) = £{6(t ~ to)} = | d(t—to)e "dt =e, ss EC (8.60) 

60 
represents a delay circuit. It can be used to show how the shift theorem of the 
Laplace transform (4.22) can be interpreted as a special case of the convolution 
theorem (8.41), just like the integration theorem and differentiation theorem. Note 
that the system function (8.60) is not a rational fraction function, as an ideal delay 


circuit cannot be implemented with a finite number of initial states or energy 
stores. 


x(t) 


—- t ae x(t) * h(t) 


7 —be- 


h(t) Jf 
Le. t 
ui) 


Figure 8.21: Convolution with a shifted delta impulse 


A system can also consist of multiple delay cireuits in parallel. It is then 
possible, for example, to describe propagation of sound waves or clectromagnetic 
waves with multiple echoes in an ideal form. Each echo is represented by its own 
delay circuit, for which the delay time corresponds to the propagation delay of the 
signal. Different levels of damping can be represented by weighting factors for the 
delta impulses. 

Figure 8.22 shows the impulse response of such a system and the result of 
convolution with a triangular input signal «(t). The impulse with weight 2 is a 
negative delay. This is of course impossible for real-world propagation of waves. 
This example is only intended to show that system theory has no problem describ- 
ing idealised systems that are impossible to implement. 

In Chapter 11 we will be investigating the sampling of continuous signals. 
Convolution with an impulse train will play an important role there as it can be 
viewed as a superposition of delayed impulses. The delay times are each a multiple 
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Figure 8.22: Convolution with multiple shifted delta impulses 


of a fundamental delay time T, which is the sampling interval. The impulse train 
can be written as a distribution 


oO 


S> d(t-aT). (8.61) 


tae —O8 


An impulse train is shown in Figure 8.23 (bottom left). Convolution of a signal 
z(t) with an impulse train leads to a periodic repetition of x(t) with period T' (see 
Figure 8.23). 

x(1) 


eX x(t) * A(t) 


er 


h(t) A 


Figure 8.23: Convolution!with an impulse train 


8.4.4.4 Control Engineering 


The principle of signals and systems, to describe systems using their input-output 
behaviour (system function, impulse response, step response) and not their imple- 
mentation has already been used for a long time in control engineering. Control 
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methods were at first (starting with steam engines) developed separately for each 
of the different areas (mechanical, electrical, chemical engineering, etc.) but it 
was soon recognised that the control procedures for very different problems all 
followed the same principles. Ways of describing systems independent. of their 
implementation were then investigated, the goal being to represent only the sig- 
nificant relationships between cause and effect. 

It was customary in control engineering Lo use the step response to characterise 
LTT-systems instead of the impulse response. This is partly because the theory of 
distributions was developed later, but also because the step response is easier to 
measure than the impulse response. That is understandable as not every sensitive 
technical or biological system can deal with a powerful spike (as an approximation 
for a delta impulse) as easily as the puck in Figure 8.13. 

The most important elements of control engineering are depicted in Figure 8.24. 
The graphical symbols each show the fundamental behaviour of the impulse re- 
sponse. The formulae for the impulse responses are shown next to them. 

The /-circuit is an integrator with a factor in front of it. It responds to a step 
with a steadily climbing ramp. Its impulse response is a scaled step function. The 
f-circuit defines systems that can store energy, for example, capacitors. 

The P-circuit is a multiplier that is defined by its factor. Its impulse response 
is a scaled impulse. 

A PI-circuit consists of a P-circuit and an /-circuit connected in parallel. The 
step and impulse responses are each the sum of the corresponding functions for 
the P-cireuit and I-circuit. 

A PT;-circuit represents a differential equation of the form 


it) + auld) = ait). (8.62) 


An example is the RC-network from Figure 8.1 (to a constant factor). The step 
response exponentially approaches a value that depends on a time constant T, 
The impulse response is a decaying exponential function. 

A DT\-circuit represents the differential equation 


1 
H(t) + Zyl) =O). (8.63) 
An example is the RC-network from Figure 6.3 with the step response shown in 
Figure 6.5. 
8.4.5 Combinations of Simple LTI-Systems 


In Section 6.6 we investigated the combination of simple LTI-systems that were 
connected in parallel or series. We saw that the combinations of LTI-systems led 
to more complex LTI-systems whose system functions could be found easily by 
combining the component’s individual system functions. For impulse responses of 
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Name Block diagram Impulse Response 


T-circuit I/k h(t) = ze(t) 


P-circuit 


A(t) = a d(t) 


PI-circuit 


PT, -circuit 


DT;-circuit 


Figure 8.24: Linear, time-invariant control circuits 


systems connected in parallel or series, as shown in Figures 8.25 and 8.26, there 
are also similarly simple relationships. 
For the series coupling, with (6.26) and the convolution theorem, 


| H(s) = Hi(s) - Ha(s) eo h(t) = hi(t) * ha(t). (8.64) 


For the parallel coupling, with (6.29), 


| H(s) = Mls) + HAs) 9-0 h(t) = hi(t) + halt) (8.65) 


because of the linearity of the Laplace transform. A similarly simple relation- 
ship for the impulse response of a feedback system, that would correspond to the 
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[i 
x(t) y(t) identical 
output signals 
x(Z) y(t) 


Figure 8.25: Systems in series 


identical 


output signals 


. hyd + holt) 
x(t) y(t) 


Figure 8.26: Systems in parallel 


frequency-domain description (6.31) unfortunately does not exist. 

Combining the step responses, for example, to characterise LTJ-systems in 
control engineering (compare Section 8.4.4), is somewhat more involved than (8.64) 
and (8.65). If s1(t) and s9(t) are the step responses of systems with the impulse 
responses A(t) and ho(t), then 


81 (t) = e(t) * hy (8) 
(8.66) 
S(t) = e(t) * holt), 


and the complete system step response for the parallel coupling is 
s(€) = e(t) * (hy (t) + ha(t)) = 91 (t) + so(t). 


For the series coupling, however, the step functions must be combined in accor- 
dance with 


s(t) = e(t) *hy(t) *ho(t) = d(t) * [e(t) * Ai (t)] * [e(t) * ha(t)] 


= J(t) * $\(t) * 8o(t) = 31 (£) * so(t) = 81(t) * $2(t) 
(8.67) 
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One of the two step responses must also be differentiated before convolution 
takes place. Alternatively, the convolution of the step response can be carried out, 
and then the result can be differentiated. Equation (8.67) can easily be expanded 
to cover N cascaded systems. The complete step response is obtained by differ- 
entiating the component step responses or the complete product of convolution 


(N — 1) times. 


8.4.6 Convolution by Inspection 


In Section 8.4.3 we briefly dealt with the calculation of the convolution integral. 
‘This method always works, but it is cumbersome for functions that are defined by 
multiple cases, as the convolution integral takes a different form for each case, and 
each must be calculated individually. 

In this section we will describe a simple method that is well suited to signals 
with constant sections, as it is not necessary to evaluate the convolution integral for 
these sections. With some practice it is possible to find the convolution product 
with this method, called convolution by inspection. ‘The reader should try to 
acquire this skill, because it brings an intuitive understanding of the convolution 
operation which is essential for practical work. 

To demonstrate the process, we will consider the two rectangle signals from 
Figure 8.27 and first evaluate the convolution integral as in Section 8.4.3. 


Example 8.6 


& (t) * -—P t 
2 we 2 4 
t 
2 
Figure 8,27: Example 8.6 of convolution by inspection 
The two signals from Figure 8.27 are defined by the functions 
1 0<t<2 ,_ J 2 O<t<s2 
F(t) = { 0 otherwise and g(t) = \ 0 otherwise (8.68) 


To calculate the convolution integral, however, both signals must be functions of 
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z and additionally, one must be inverted and shifted in time: 


10 2 Q0<t—7<2 or 

2 Sts a= oe ee 8.6 

el { 0 otherwise end: eh) ( ee > 0?) 
0 otherwise 


The product f(z) g{t — c) is zero for certain sections of ¢: 


0 t<0O 
2 0sest O2t23 
: Q otherwise he 
He)gt-o=4 7, (8.70) 
ate rk 2 bya, 
0 otherwise aoe 
0 4<t 
The convolution integral takes the values 
t 
f2ee Vata? 
o 0 
y a} L— =_— 2 
ui= f seat- eae eee peas 
—0° E-2 
0 otherwise 
ot 0<t<2 
= 4—-2t 2<t<4 (8.71) 
0 otherwise 
This defines the triangular signal shown in Figure 8.27. 
a 


The method of calculation we have shown here is correct, but because we had 
to consider various different cases it is unnecessarily cumbersome. Looking at the 
simplicity of the result, it seems likely that there is a simpler way of performing 
this convolution. 

The first property that is noticeable, is that because the signals f(t) and g(t) 
are piecewise constant, the product f(z) g(t ~ z) can also only have a constant 
value for some sections. Consequently, the convolution integral gives either the 
value zero (when f(z) g(t — 7) = 0) or a linearly growing or decaying function. 
It is therefore sufficient to only calculate the value of the convolution integral at 
certain points, where the value of f(c) g(t— 7) changes. The intermediate values of 
the convolution integral can be obtained by linking the points by straight lines. To 
explain we will repeat the last example with the graphical method just described. 


Example 8.7 
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Determining the convolution of f(£) and g(t) from Figure 8.27 requires that we 
first take g as a function of z, and invert g(z) to give g(—z). Shifting backwards 
and forwards is performed with g(t — c) and various values of t. For t < 0, f(z) 
and g(t— 7) do not overlap, but at t = 0 both rectangle functions start at the same 
point, 7 = 0. For 0 < ¢ < 2 the two rectangles overlap in the region 0 < z<t. At 
t = 2, f(z) and g(2 — c) cover each other comletely. For 2 < t < 4, the overlap is 
only in the region t — 2 < zc < 2, and at t = 4 the rectangle functions f(z) and 
g(4 — c) only border each other, at c= 2. When t > 4 their is no longer any 
overlapping. The critical points are therefore: 


e t=0 no overlap until this point, 
e{t{=2 complete overlap, 
@t=4 no longer any overlap. 


At t = 0 and t = 4 the value of the convolution integral is zero (f(z) g(—c) = 0 
and f(z) g(4—7z) = 0). At t = 2 the product f(z) g(2— 7) has the value 1 x 2 = 2; 
the value of the convolution integral is equal to the area of a rectangle with height 
1 x 2 and width 2, ie., 4. The result of the convolution of f(#) and g(t) can be 
obtained in a graphical way by linking the individual points (0,0), (2,4) and (4,0) 
with straight lines. For f = 0 and 4 < t the value of the convolution integral is zero. 
This forms the triangle in Figure 8.27 without any integration being necessary. 


The procedure we have just described can be summarised as a general method 
for graphically determining the convolution of signals with constant sections. 


1. Turn one of the signals around and imagine shifting it. As convolution is 
commutative, this can be done with the simpler of the two signals. 


2. Recognise and note the the displacements where changes in the overlap be- 
tween the two signals occur. 


3. Determine the convolution integral at these points by forming the product 
of both signals and calculating the areas from height x width. 


4. Mark these points on the time axis (t) aud link them with straight lines. 
Sections on the time axis where no overlapping occurs are given the value 
Zero. 


We will now give two examples of how this procedure should be followed. 


Example 8.8 
We want to perform the convolution of the two signals from Figure 8.28. 


1. We choose signal g(£) to be turned around and shifted because it starts at 
t= 0. 
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3 


Figure 8.28: Convolution by inspection (Example 8.8) 


2. The recogniseable points on the time axis are: 


© att=1 f(z) and g{1 — Zz) start to overlap. 
@ at t = 2 g(2— 7) completely covers the rectangle f(r), 
@ it remains completely covered while 2 < ¢ < 4 and stops at t = 4, 
@ at t = 4. g(t — c) only partially overlaps f(c), 
® at t = 5 the functions no longer overlap. 
3. While f(z) is completely covered(2 < 4 < 4), the value of the product 


F(c) g(t — ct) is 2x 3=6. The convolution integral then has the value of a 
rectangle with height 6 and width 1, which is 1 x 6 = 6. 


A. Marking in the points (1,0), (2,6), (4,6) and (5,0) and linking them forms 
the trapezium shown Figure 8.28. 


Example 8.9 
Figure 8.29 shows the convolution of a rectangle signal with a non-rectangular 


signal, which is, however, constant in sections. Using our prescribed procedure 
leads to the following results. 
1. The signal g(¢) is the simplest and so it will be reversed and shifted. 


2. The characteristic points are: 


et=<1 overlapping starts, 
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uC) 


Figure 8.29: Convolution by inspection (Example 8.9) 


et =3 the rectangle is cornplctely superirmposed over 
the higher part of f(z), 


etmd4 the rectangle stops being completely superimposed over 
the higher part of f(z) and starts being partially superimposed over 
the lower part of f(z), 


e@ft=5 the lower part of f(z) is completely covered by the rectangle, 


eo i=6 the rectangle no longer covers any part of the higher part, 
and only partially overlaps the lower part, 


et=7 all overlapping with f(z) stops. 
3. By multiplying the signal with constant sections at the characteristic points, 


constant products are obtained. Determining tlir areas gives the following 
yalues for the convolution integral: 


et=l1 LK —t)g(c)de =0 


ef=3 LfQ-2)o(2)ae — 12 


et=1I ff f@-xc)g(t)dr = 12 
etx5 pe g(z)dzt =6-— 3= 3 


ei=6 th f(-—cg(ede = 3 
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et=7 f(@—cg(cjde =0 


Ze 


4, Marking the points (1,0), (3.12). (4,12), (5,9), (6,3), (7,0) and linking them 
with straight lines forms the result depicted in Figure 8.29, 


Comparing Figures 8.27, 8.28 and 8.29 it becomes clear that the length of the 
convolution product is equal to the sum of the Icnglits of the two signals. The 
points at the start and end of the convolution product are also the sums of the 
individual start and end points. It can easily be shown that this is generally true 
for the convolution of all time bounded functions (not just those with constant 
sections), by using point 2 of our procedure on the start arid end points of overlap 
for general signals, as in Figure 8.30. 


t 1 iy 
taj tej | 
| | 
| | 
| tagtt toit+t 
| | alT ta2 el Tte2 


Figure 8.30: Length of the convolution product of two finite functions 


The prescribed procedure for signals with constant sections can be used on 
all signals that can be described in sections by polynomials. The convolution of 
these signals with degrees K arid £ leads to a convolution product with order 
AKo+L +1. That means that convolution d a triangular signal ( = 1) with a 
rectangular signal (L= 0) would have a convolution product formed from second- 
order parabolic sections (K+L+ 1=2). The convolution ot two triangular signals 
(& = L = 1)gives a third-order convolution product (K +£+ 1= 3). 


8.5 Applications 


Many interesting uses of signal processing are based on convolution relationships. 
Here we will examine two examples, matched filters arid de-convolution. 
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8.5.1 Matched Filter 


In many practical tasks, the aim is to recognise known signal forms, which means 
identifying what point in time they occur and distinguishing them from other 
signal forms. Examples d these tasks are speecll recognition. object recognition 
in images, etc. 


Principle: In the simplest case wc want to recognise when a signal component 
m(t) occurs. That means we are dealing with a signal d the form 
x(t) = m(t =ta). (8.72) 


where the function m(t) is known hut the time tg by which m(t) is shifted i5 not 
known. For example, we could transmit an acoustic signal m(t), and with the echo 
x(t), determine the unknown time taken for it to return. 
To achieve this, the received signal x(t} is filtered with an LTI-system that. has 
an impulse response derived from the signal form m(1): 
A(t} = m(--t). (8.73) 


The minus sign in m(—t) cancels out the reversal of the signal in convolution, so 
the output signal is 


y(t) = h(t) * a(t) = | A(t — cz) x( =) m(c~t)ax(c)de. (8.74) 
00 OS 
For an input signal of the form (8.72), the output signal is 


oO 


y(t) = / m(z—t)m(c—to)de. (S.75) 


OS 


‘The output signal will be maximal at the unknown time fy: 


oO oc 
y(to) = / m?(c—ty)dz> | m(t~t)m(e—to)dz. (8.76) 
-oo x 


The integral over the always positive value m?(z — ty) must be at [rast greater 
than y(t} except at f — lp. Suitable choice of the signal m{#) can make the value 
of y(to) much greater than all other values of uy and then the unknown time 
to can then be recognised as the peak in the signal y(t). Figure 8.31 shows the 
corresponding arrangement of a filter with impulse response (8 73) and a peak 
detector. A filter of this kind is called a matched filter. 
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peak 
m(-t) detection 


Figure 8.31: Finding a signal pattern m(t) using convolution with m(—t) 


Example 8.10 


As an example of a possible application for a matched filter, we will consider 
the arrangement shown in Figure 8.32,intended to count and roughly measure the 
speed of vehicles. The only source of information available is the signal from the 
distance sensor, which gives the distance between itself arid an object. below it for 
allt. The problem is to decide what kind of vehicle is passing, work out its speed 
and count the number. of each kind of vehicle. Typical forms of signal for.cats and 
lorries moving quickly or slowly are shown in Figure 8.39. 


distance 
sensor 


x(t) 


— gs —[! 


Figure 8.32: Counting and measuring the speed of vehicles 


COCCCCC 


A system that perfornis the counting function with the signal x(t) from the 
distance sensor is depicted in Figure 8.31. The sensor signal runs through a bank 
of four filters that each responds to a different class of vehicle using the templates 
in Figure 8.34. For each filter. the maximum detector recognises if and when its 
signal form has occurred, and these events arc automaticnlly counted to give the 
desired result. 


8.5.2 Deconvolution 


Sometimes the problem docs not require that a signal is changed by a filter, but 
instead that an already filtered signal is returned to its originial form. Problems 
of this kind often occur. 
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Slow car my(t) | 
cee | 
m(t) 
Fast car 
iccan 2 
Slow lorry 7st) | 
t 
ma(t) 
Fast lorry 
coca | 


counter 
slow cars 


maximum- 
detection 


counter 
fast lorries 


counter 
slow lorries 


Figure 8 34. Block diagram of the detector 


e A microphone recording made in a room is the convolution of the sound 
signal produced by the instrument or voice with the impulse response of the 
surrounding space. The impulse response of a room can by heard as the 
response to a clap or the crack of a whip. This convolution must, be done in 
reverse to remove the interference. 
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e A blurred image from a camera can be interpreted as convolution with ¢ 
smothing system ‘Whe impulse response is the blurred spot that would be a 
sharp point on the original image 


® A radio channel with multi-path propagation can be described by an impulse 
response that consists of multiple time-shifted echos (see Chapter 8.4.4 3). 


e The inertia of measuring instruments has a smoothing effect on the mea- 
sured signals and smooths sharp steps into slowly rising slopes. The impulse 
response of such sy stems can often be modelled by an RC-circuit with a large 
time-constant. 


If the impulse response h(t) is known tor such a system, then it is porsible to 
attempt to invert the influence of /#(t) by convolution with a second LTI-system 
g(t). In the icleal case the result is again a delta impulse: 


g(t) * h(t} = d(t). (8.77) 


The system function G(s) = £{g(t)} of the second system can be cxpiessed by the 
system function H(s) = £{h(t)}, using the convolution theorem: 


(8.78) 


The effect of a system with system function G(s) is called deconvolution. It is 
rarely possible to carry out in the ideal form of (8.78), because the measured sig- 
nals usually have additional noise interference. In addition, signal components 
that were suppressed completely by the first system (zeros of the system func- 
tion), cannot be recovered from the second system. The filter that represents the 
best compromise between deconvolution and noise reduction will be introduced in 
Chapter I8 as the Wiener filter. A system with system function G(s) (8.78) could 
also be unstable. This problem will be dealt with in Section 16.3. 


8.6 Exercises 


Exorcise 8.1 


Show that the response of an RC-cireuit to a short rectangle impulse (8.7) turns 
into the impulse response (8.4) for Ty > 0. 


Exercise 8.2 


Using the calculation rules for the delta impulse, determine: 


a) fa = ia e~ S(t) dt 
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Sf ey (t— zc) dt 


Patoval 


c) fe= f (2-2) 6(3t) at 


a) Ja= fre *6(4 — 2t) dt 


Exercise 8.3 
The following signals are each turned on at ¢ = 0: 


a) x,(t) 


b) Xp(2) 


0 2 4 6 t 


sive x(t) and x,(t) using the step function ¢(¢) for both, then form the derivations 
and sketch them. 


Exercise 8.4 


Form the derivation of f(£) = ¢(—t) 


Exercise 8.5 


Form the derivation of f(t) =<(at). 


Exercise 8.6 


You are given the functions f(t) = te(t) and g(t) = e({t) — e(¢ — 4). Calculate 
y(t) = f(t) * g(t) using the convolution integral. 


Exercise 8.7 


Examine the following signals: 
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xi) x3(t) 
2 


The following convolution products are also given: 


yy (t) 


1 


For each of the convolution products, determine the pair of signals 2, and x, that 
created this result. 


Exercise 8.8 
Find the response of the RC-network shown in Figure 8.1 to the rectangle impulse 


OX? 
shown in Figure 8.3 by solving the convolution integral [ h(z)a(t — 2) de. 
Note: see Section 8.4.3. 


Exercise 8.9 


Kor the example of an RLC-network (Chapter 3.2.3), give 


a) the system function (note that i(t) is the output variable) 
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b) the impulse response 
c) the region of convergence of the system function 


d) Which values can the parameters oy and wo of the input signal u(¢) take, so 
that the system response 2{t) converges? Assume that u(t) is right sided. 


9 The Fourier Transform 


Like the Laplace transform, the Fourier transform plays an important role in 
system analysis and tlie rriodellirig of LTI-systems. Its defintion, properties and 
usage will be examined in this chapter. 

After we have already proven that the Laplace transform is very useful, one 
may ask why there is a need for another transform. We will tharefore start the 
chapter with a critical review of the Laplace transform. 


9.1 Review of the Laplace Transform 


In the previous chapters we got to know the Laplace transform as a model of LII- 
systems that were described by differential equations. It allowed us to evaluate 
the system response in an elegant way. in particular if there were initial conditions 
to consider. 

The obvious advantages d the Laplace transform only come with LTI-systems 
that are characterised by a clear number of poles and zeros, o1 equivalently, are 
described by a differeiitial equation with constant coefficients Other important 
LTI-systems also exist, however, that cannot be characterised by a few poles and 
zeros. for example the delay circuit in Chapter 8.4.4.3 We will learn furthei unpor- 
tant examples in this chapter. Attempting to describe such LTI-systems using the 
Laplace transform leads to system fiinctions with an infinite number of poles and 
zeros, or with essential singularities, It is actually possible to work around these 
difficulties, but the mathematically correct methods require significantly more ad- 
vanced knowledge of function theory than we have discussed in Chapter 5 Even 
worse is thr fact that the elegance of the method modelling systems as a few 
complex natural resonances in the time-domain arid frequency-domain - is lost. 
The Laplace transform is particularly suitable it we arc concerned with signals 
of finite duration, or unilateral signals. We have represented these signals with 
the Laplace transform as overlapping eigenfunctions of LTT-systems which have 
the form e*', although £{e°’} does iiot exist. The same also goes for £{sinwt}, 
Li{cos wt} and £{1}. In this chapter we will see how elegantly the Fourier trans- 
form overcomes this problem if generalised functions in thr frequency-domain are 
permitted. 

There are more aspects of out previous dealings with the Laplace transfoim 
that we have riot yet made fully clear: putting the system model in the frequency- 
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domain has the primary goal d making calculations simpler to carry out than 
they would be in the time-domain. The first example of this is the evaluation 
of the system response, which can be represented in tire frequency-domain as a 
multiplication by the system fiinction, but in the time-domain requires the use of 
the convolution integral. AS a, second example, we give the analysis in natural 
resonances which is so simple in the frequency-domain using partial fractions. 
that we have never done it iii the time-domain. In all cases, however, we have 
returned to the time-domain after using the advantages of the frequency-domain 
representation. 

We have rarely attempted (o characterise or design systems directly through 
their properties in the frequency-domain. The onl; time bring the description of 
a system function by the poles and zeros in the complex s-plane (see Chapter 6.3). 
The interpretation of such pole-zero plots is not so simple, however, because the 
system function is a complex function of complex variables. It fails completely 
for systems that cannot be described by a differential equation with constant 
coefficients, for example, a delay circuit. Furthermore, because the system function 
H(s) has to be analytic in the region of convergence, designing a system in the 
s-plane is difficult. as this property may be violated. 

The following point summarise the disadvantages of the Laplace transform 


e It only provides a simple and elegant system model for LTI-systerns that can 
be described by ordinary differential equations with constant coeflicients. 


e The Laplace transform does not really exist tor signals e*’, that are eigen- 
functions of LTI-svystems. 


@ From the system function, the properties of a system in the frequency domain 
cannot easily be seen. 


As an alternative to the Laplace transform, we now consider the Fourier trans- 
form. We will see that it overcomes the stated disadvantages of the Laplace trans- 
form. while also keeping many of the merits. 


9.2 Definition of the Fourier Transform 


9.2.1 Forward Transformation 


At first, the definition of the Fourier transform looks similar to the Laplace trans- 
form. A signal is also projected with complex exponential oscillations by an in- 
tegral transformation. The complex frequency of these exponential oscillations is 
however. purely imaginary, so no decaying or growing oscillations occur, 


Age) = Fiat = [ a(the tat (9.1) 
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The result of the transformation X (jw) is called the Fourzer Transform, Fourzer 
spectrum or complex amplitude spectrum. The complex exponential oscillation 
e7/“t is known as a complex function of tame. The real variable w is the frequency 
parameter or the frequency. The Fourier transform therefore depends on the real 
frequency parameter, but can itself take a complex value 


X (gw) = |X(qw)} -e7? 9%) , (9.2) 


Its magnitude LX (jw)| is called the magritude spectrum. The phase spectrum 
ei?) is usually expressed by the phase y(jw). At the beginning it is confusing 
that one writes X(jw) and p(jw), and not X(w) and yw). The argument jw is 
just a convention, which means that a one-dimensional complex function in the 
Gaussian number plane on the imaginary axis is being defined it could also be 
defined as X(w) on the real axis, and there are actually several books that do this 
~ the dependency on w is unchanged. The sense df tlie jw convention becomes 
immediately clear. if a relationship between Fourier and Laplace transforms is 
made (Section 9.3). For the Fourier transform, the abbreviated correspondency 
form 


X (jw) e—o x(t) (9.3) 


will be used We use the same symbol e—o for different transforms, for example, 
the Laplace, Fourier and later. the z-transform. This symbol is not a strict mathe- 
matical assignment, but typographical short-hand for ‘corresponding to each other 
in the original and transform domain’. Some textbooks attempt to use different 
symbols for different (ransforms, in order to give a strict mathematical meaning. 


9.2.2 Existence of the Fourier Transform 


Like the Laplace transform, the Fourier transform only exists for a certain class of 
signals. If a function of time x(t) is absolutely integrable, that is sufficient for the 
convergence of the Fourier integral. If 


| |x(t)| dt < oo, (9.4) 
then 
“B nae 
|X(jw)| < lim [ ja(te "| dt = lim / je(t)| de. (9.5) 


This condition is sufficient but not necessary, and there are in fart time fune- 
tions that although not integrable, have a Fourier transform. Examples of such 
time fanctions and their Fourier transforms are 


ap) Bnet on ie A a for \w) <1 oh 
i ae en AUR) { 0 for lw[ >1 (9.6) 
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and the step function ¢(f) 


PES B28 2G] Oe z (9.7) 
We will deal with the evaluation of these Fourier tranforms in the course of this 
chapter. 

The Fourier transform of the step funetion contains a delta impulse 6(w). Up to 
now, we have encountered it in the time-domain, but not in the frequency-domain. 
As Laplace transforms in the region of convergence are analytic fimctions. there 
is no room. there for generalised functions. However, with Fourier transforms that 
arc functions of a real parameter w (just as with functions of time), the extension 
to cover generalised functions does make sense. The popularity of the Fourier 
transform comes from the possiblity of assigning a spectrum with the help of the 
delta impulse to many important practical functions for which there is no Laplace 
transform. Some elementary examples are constants (e.g. x(t) = 1) arid the 
trigonometric functions sin wot and cos wot. 


9.3 Similarities and Differences between Fourier 
and Laplace Transforms 


The differences between Fourier and Laplace transforms were previously discussed 
as the Fourier transform was introduced as an independent transformation. There 
are many cases, however, where the Fourier and Laplace transform formulae agree. 
Comparing the Fourier transform and the bilateral Laplace transform, 


oO POS 


F{a(t)} -| a(tye “dt c{x(t)} = | a(t)e*dt (9.8) 


— OO Pome OD 


it can be seen immediately that the Fourier transform of a function of tiinc is the 
same as its Laplace transform on the imaginary axis 5 = jw of the complex plane. 
That is of course only true if the Laplace transform exists as well. The connection 
between Laplace and Fourier transforms is: if the region of convergence of £{x(t)} 
contains the imaginary axis s = jw, then 


F{a(t)} =£{x(t)} (9.9) 


s=qw 


With (9.9) the convention should now make sense, that the Fourier transform is 
defined on the imaginary axis and not on the real axis. 
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Example 9.1 


The function 


a(t) =e(t)e™™, a>O0 (9.10) 
has the Laplace transform 
1 : = 2 
X(s)= ‘ Re{s} > -a 9.11 
(s)=——, Refs} (9.11) 


Tlie region of convergence lies to the right of the negative number — a, and thus 
contains the imaginary axis of the s-plane with Re{s} =0. 

The Fourier transform is obtained by substituting (9.10) into the detintion of 
the Fourier transform (9.1) arid evaluating the integral 


X(jw) = (9.12) 


juta’ 
This clearly shows the connection (139) between the Fourier and Laplace trans- 
forms 

If, however, a <Q in (9.10).the Fomier transform does riot exist, because the 
Fourier integral does not converge. The Laplace transform, on the other hand is 
unchanged (9.11), although the region of convergence now lies to the right of the 
positive number -a arid no longer contains the imaginary axis. 


If the rcegiori of convergence of the Laplace transform contains the imaginary 
axis. {he Fourier transform (9.9) can then be differentiated any number of limes. 
The Laplace transform can therefore easily be obtained from tlie Fourirr transform 
using analytic continuation (Chapter 5.4.3). In practice, this means that jw is 
replaced by s and the region od convergence defines the Laplace transform 


Example 9.2 
What is tlie Laplace transform of the signal with Fourier transform 


1 


aaa a 


(9.13) 

Expression (9.13) has no singularities for real values of w and can be differen- 
tiated at all points. We can perform analytic continuation on X (jw), where we 
write 


(9.14) 


(9.15) 
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X(s) has poles at s = —l and s =-+1, therefore 
-1< Re{s} <1, 


as the ROC must contain the imaginary axis. 


In Example 9.1 we saw that signals exist which have a Laplace transform, 
but no Fourier transform. We will also see that signals like x(t) = e?“* and others 
derived from it (constants, trigoiionietric functions, etc.) liavr a Fourier transform, 
but no Laplace transform. The Fourie: transform is therefore a necessary and 
meaningful companion of the Laplace transform. This is particularly apparent 
for selective systems (filters) that are characterised by their frequency behaviour, 
because then the system properties can he read immediately from the Fourirr 
transform of the system response. 

The Fourier transform also has great importance for digital signal processing, as 
its discrete counterpart, the discrete Fourier transform (DFT),can be implemented 
directly as a computer program or as a circuit. With it, discrete-time signals can 
be worked with directly in the frequency-domain. 


9.4 Examples of the Fourier Transform 


In this section we mill find the Fourier transform of some important signals. which 
we will refer to later. 

9.4.1 The Fourier Transform of the Delta Impulse 

The Fourier transform of the delta impulse is obtained by inserting it into the 


Fourier integral (9.1), and using its selective property. 


X(jw) =f s(yerrat = j (9.16) 


OG 


The result corresponds to the Laplace Iransform, as in this case the conditions 
for (9.9) have been fulfilled. Figure 9.1 shows the corresponding transform pair 


a(t) {8(1)} 


Figure 9.1. The delta impulse and its Fourier transform 
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We obtain the Fourier transform of a shifted delta impulse the same way: 
X (jw) = ii O(t~ cje I“ dt =e I=. (9.17) 
aise 


In contrast to the Laplace transform, for which the function’s behaviour as a 
complex function is difficult to represent, we can more easily represent the Fourier 
transform graphically. as a complex function of a real variable. ‘Uhis is most siraply 
done by splitting it into real and imaginary parts, or into magnitude and phase 
of the complex transform (Figure 9.2). The shift of the delta impulse does not 
change the magnitude of the Fourier transform, but instead changes the phase 
p(jw) = arg {F{d(t — r)}} so that it decays linearly. The gradient. of the phase 
corresponds to the amount of displacement z. The phase of F{6(t)} has the value 
zero, and is not shown in Figure 9.1. 


4 {17} 


O(tt) 
0) 


arg{ ¥ {0(t—-v)} = — wr 


Figure 9.2: Shifted deita impulse and its Fourier transform 


9.4.2 Fourier Transform of the Rectangle Function 


To find the Fourier transform of the rectangle function. we first introduce an 
abbreviation. of which we will make widespread use. A rectangle function is easy 
to draw (see Figure 9.3), but dealing with the piecewise definition in (9.18) is not 
suitable because of the necessary case distinction. We therefore use the notation 
rect(¢) to indicate the rectangle function, arid deal with the symbol rect as the 
function defined in (9.18). 


1 
4 Poe Let = 
1 for [tl < 5 (9.18) 


x(t) = rect (t) = 
0 otherwise 
The limits at = +4 are chosen so that the rectangle rect(¢) has unit height, 
width and area. Rectangle impulses with other widths will be described by scaling 
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rect(f} 


Figure 9.3: The rectangle function 
with a factor a> 0: 
L fort} < = 
recto) = ent S55 (9.19) 
0 otherwise 


The Fouricr transform of the rectangle function is obtained by evaluating the 
Fourier integral 


— oO 


oo +4 7 +4 
F{rect(t)} = i rect(t)e-mtat = f et de = —_ 


tay — jw 


(9.20) 


4 
The plot of tlic transform F {rect(t)} is shown in Figure 9.4. 


» F {rect()} 
1 
a 
/ 
/ 
\ 
/ 
2 se oN Las es ee ee aes ye ae <—* wo 
é a Ae _ : 


Figure 9.4: Fourier transform of the rectangle function 


We will also introduce an abbreviation for this characteristic function. We call 
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it the si-function and define it as 


si for v £0 
si(v) = os (9.21) 
1 forv=0 


In spite of the value v in the denominator, si(z’) is continuous, so — 0 corresponds 
to the limit that we obtained at this point from the l’Hopital rule. 
Figure 9.5 sliows the course of si(v), dependent on the dimensionless variable 


’ si(v) 


| 
A. 
! 


1 


Figure 9.5: The si-function 


For the entire area under the integral 


/ si(v)dv = 7, (9.22) 


vm OO 


This area corresponds exactly to the area of a triangle between the main peak and 
the first two zero points to the right and left of v = 0 (see Figure 9.6). This rule is 
very practical as it can be also used for any other si-function, whether it is scaled 
in the horizontal or the vertical axis 


With the si-function, we can very elegantly formulate the correspondence be- 


tween the rectangle function and its Fourier transform. By comparing (9.20) 
and (9.21), we find that 
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Figure 96: The area of the triangle corresponds to the integral of the si-function 


For rectangles with any width a, we obtain from (9.19) 


1, 
rect(at) o—e— sil — |. (9.22) 


In Figure 9.7, rectangle functions and their spectra are represented for different 
values of a. As the scaling factor a occurs as a multiplier in the time-domain 
and divisor in the frequency-domain, the spectra become wider as the rectangle 
function becomes thinner. We will sec later that this effect is a general principle. 
and occurs with many other functions of time. 


9.4.3 The Fourier Transform of a Complex Exponential 
Function 


‘The previous Fourier transforms could be solved by evaluating the Fourier inte- 
gral (9.1). This process is unsuccessful for the complex exponential function 


altho? (9.25) 


as the integral that arises 


elvote—jut dt = ciiwo—w)t dt 


clearly does not converge for w = wy. Nevertheless, the Fourier transform e“° 
can be given in the form of a distribution. To derive this, we use the si-function 
that we have just introduced. 

In order to overcome the mentioned convergence problem for integration of an 
oscillation of infinite duration, we consider first of all a section of the oscillation 
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1 
—_ 
= 
™ 
¢ 
a 
i 


a=2 


1 1 t 
a 4 


Figure 9.7: Various rectangle fimetions rect(at) and their Fourie: transforms 


with finite duration: 


eet for li <7 
xy(t) = (9.26) 
0 otherwise 


The Fourier transform of this can be found easily, and the steps required are the 
same as for the Fourier transform of the rectangle function, carried out in (9.20). 
They both lead to a result that can be expressed by the si-function. 


- ie 
X7(jw) = | eluate It de a ik elwo-w)t 
We ees 
F 
= ! ellwomwyt 
J(wo — w) 


2sin(w—wo)T _ 


ey We ce (corer 22 “How? 


_p  Ilwy — w) 


QT si((w—wo)T) . (9.27) 


Figure 9.8 shows a plot of this spectrum. It is tlie sarne as the spectrum shown in 
Figure 9.7, but is shifted by wo on the frequency axis. 

Since the complex exponential funetion in (9.25) consists of the signal of finite 
duration a(t), with the limit T » 2 the spectrum of z(£) is also obtained from 
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Figure 9.8: Spectrum of a complex exponential function of finite duration 


X (jw) with this limit. If we write X(jw) with T= x as 


1 er 
RGa= ai af? =), (9.28) 


we recognise from Figure 9.7, that X(jw) becomes a spike with height, approach- 
ing infinity and width approaching zero, for T -+ oo (soa > 0). X7(jw) can 
clearly not be represented by an ordinary function, so we ask whether it can he 
expressed by a delta impulse. To do this we must test X7(jw) for the selective 
property of the shifted delta impulse (8.15) with the limit 7’ — oo. We form the 
product of X7(jw) and another function (jw), that is constant at w = wo, but 
can otherwise be any function. For large values of 7’, the function Xp(jw) becomes 
ever smaller (apart from at wo), (sec Figures 9.7 arid 9.8), and so when the product 
X7(jw)F (jw) for T — oo is integrated. only the value F\(jwo) is contributed: 


i. lim X¢(jw)F' (jw) dw = FGjwo) f Xp(yw) dw. (9.29) 
ase T1090 30 

The area under the si-function is, however, the same as the area under an isosceles 
triangle with its base between the two zero points next to the maximum of the 
si-function (see Figure 9.6). That means here from Figure 9.8 that. 


eee ee 1 2 
i Xr(jw) dw = is 2T si((w — wo)T)) dw = 5 QT - = = 27. (9.30) 
- ah a 2 
Equation (9.29) thus becomes 


2 


OO 


aa | : 
/ 5 im Xr (qu) F (gw) do = F(jwo) (9.31) 
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The function + t lity oc Xq (jw) clearly removes all values of F(gw) except at 
w =wy. That is exactly the property that identifies the delta impulse. We can 
therefore write 


‘ 


1 : 
jun 5 Xu) = 6(w wa). (9.32) 
L300 LIT 
Combining these results yields 
Fl{eivory = F{ jim ap(t)} = jm Xp(gw) = In d(w — wo). (9.33) 
Poo 


We have now obtained the transform pair for tlic complex exponential function: 


(9.34) 
It is similar to the transform pair for an impulse shifted in the time-domain (9.17): 
o(t ~ c)o—e e I#7, (9.35) 


9.4.4 Fourier Transform of : 


A further example for a tiine function whose spectrum cannot be found by simple 
evaluation of the Fourier integral is the function 


(9.36) 


shown in graphical form in Figure 9.9. As the time function 3t t = 0 grows 


x(t) 


% 


Figure 9.9: Temporal behaviour of the function 4 


beyond limit, it is not easy to integrate over this point. It helps to split the 
integral into two parts for f <0 and ¢t > 0. The upper integral is solved first for 
the finite limits ¢ and 7, with 0 < —E < T < oo, and the lower integral is then 
solved correspondingly for —7' and —+. From the results of these two integrals, 
tlic solution can be obtained by the two limits T — oo and & — 0, as long as 
thew two limits can be evaluated. Tliis procedure is also known as calculating the 
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Cauchy’s princeple value. For x(t) according to (9.36) the necessary steps are 


ox Me, a 
, 4 1 ] 
Flat} = X(Gjw) = [yew = lim [peotas fi et dt 
“OO iat (a € 
“1 wt 
m ie =(e7 It — eJ”\dt = lim —27 jee dl. (9.37) 


To evaluate this improper integral, we can use (9.6), or even better the triangle 
rule (Figure 9.6). Please note that a change of sign of w also leads to a change of 
sign of the amplitude of the si-function. For w = 0 the calculation is trivial. We 
obtain 
q ate —jx forw>0 
FA eit. = lim -2j | = di= 0 forw= 0... (9.38) 
T—00 “ jr forw<0 


The three different cases for the sign of w can also be expressed by the signum- 
function sign(w). We can now give the transform pair in the simple form 


1 
rea jm sign(w) ] (9.39) 


A purely imaginary spectrum is obtained that has a constant value for both posi- 
tive and negative values of frequency w (sec Figure 9.10). Because of the discon- 
tinnitv, X(jw) cannot be analytically continued The funetion x(t) = + cannot 
be absolutely integrated (9.4), although its Fourier transform can be determined. 
This illustrates once again, that if a function can he integrated, that is a sufficient 
but not necessary condition for the existence of the Fourier transform. 


X(jo) 


Figure 9.10: Spectrum of the function + 


9.5 Symmetries of the Fourier Transform 


From the examples of Fourier transforms of simple signals that we have looked at 
so far, we can see that it is possible to determine the spectra of more complicated 


signals without having to do more integration, if the properties of the Fourier 
transform are known. That is why symmetry relationships are so useful. If certain 
properties of a signal are known, the appearance of the spectrum can be determined 
and vice versa. To describe the symmetries of a signal, we will first of all introduce 
the concepts of even and odd functions, and investigate how they relate to the 
corresponding spectra. 


9.5.1 Even and Odd Functions 


Even and odd functions are characterised by their behaviour when the signs of 
their arguments are changed. 


Definition 13: Even and odd functions 


Two real functions x.(t) and xo(t) are called even or odd functions when: 


re (—t) (9.40) 
(9.41) 


Every function can be split into an even and an odd part 


z(t) = a2-(t)+a,(t), (9.42) 
where tire terms are given by 
1 
Rat) 5 (z(t) + x(—#)) (9.43) 
I 
Xo(t) = 5 (a(t) - z(—t)) : (9 44) 


With (9.40), (9.41) it is easy to confirm that x.(¢) and x,(t) have the assumed 
symmetries. 


Example 9.3 


For the right-sided function x(¢) from Figure 9.11, the even and odd terms are 
both bilateral functions, the sum of which disappears for t < 0. 


ce | 

The even and odd symmetry that we introduced here with functions of time 

can, of course, also be carried over to functions of frequency w. Even and odd 
spectra are identified by 

X-(jw) = X.(-jw) (9.45) 

X(jw) = Al agw) (9.46) 


The definitions for even and odd functions arc equally valid for both real and 
complex signals. 


210 9. The Fourier Transform 


x(t) 


+ ae 
t Xft ) 
™~. 


Figure 9.11: Combining the even and odd parts of a function 


9.5.2 Conjugate Symmetry 


For the real and imaginary parts of complex signals, there are often different 
symmetries that can be summarised by the concept of conjugate symmetry. 


Definition 14: Conjugate Symmetry 


A complex function x(t) has conjugate symmetry when: 
x(t} =a"(—t). (9.47) 
_ Here x*(t)means the complex conjugate of the function x(t). 


By splitting x(t) = Re{a(t)} + jlm{a(t)} into real and imaginary parts, it is 
immediately clear that a function with conjugate symmetry has an even function 
as the real part and an odcl function as the imaginary part. 

Of course, this definition also applies to functions of frequency. Correspond- 
ingly, for a spectrum with conjugate symmetry, 


X(gw) =X*(—ju) . (9.48) 


9.5.3. Symmetry Relationships for Signals with Real Values 


We will now use the symmetry relationships just introduced to describe the con- 
nection between time signals and spectra, starting with real-value time signals and 
investigate how these properties manifest themselves in (tie frequency-domain. We 
will apply both operations associated with conjugate symmetry, one after the other 
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to the Fourier integral (9.1) for a real function of time «(t): 


X(gw) = [ atyemta 


pe 
X(—ju = / x(t)er dt 
~0O 
X*(—jw) = [ a*(t)e It qi= | a(t)e I di 
J -00 ; 


As the real function z(t) does riot change when transformed to the complex con- 
jugate function z*(¢), the operations cancel each other out. Real signals thus have 
conjugate symmetrical spectra 


| x(t) real + X(jw) = X*(—jw) . | (9.49) 
As spectra with complex values can be represented as real values of imaginary 


and real parts, or alternatively as magnitude and phase, conjugate symmetry of 
X (jw) can be expressed by even or odd symmetry of these components 


CG Ss ee (9.50) 
Re{X(jw)} = Re{X(~—jw)} real part cven. (9.51) 
Im{X(jw)} = ~—Im{X(—jw)} imaginary pait odd. (952) 

[X(jw)| = [X(—jw)| magnitude cven, (9.53) 
arg{X(jw)} = arg{X(—jw)} phase odd. (9.54) 


We would further like to know which parts of the time signal correspond to 
the real and imaginary parts of the spectrum. Starting with the real part of 
the spectrum, with the Fourier integral (9 1) we substitute ¢ = —t for the time 
variable, bearing in mind that Re{e~/#'} = cos(wt} is an even function: 


Re{X(qw)} = / "gl icolabid? 


om (XD 


REN Guh oe i "gee ees an aude 


J—oo 


ox 
Re{ X(jw)} — | a(t) cos(wt) df 
J—xO 
Tn the last row we have again set 7 =, as the value of the integral does not depend 
on the notation used for the integration variables. All right sides are identical, so 
for a real function of time with a real spectrum it must be trne that a(t} = x{—t). 
According to Definition 13. (t) is an cven function. 
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The same deductions can be made for the imaginary part of the spectrum, 
which brings us to the conclusion that a real function of time with an imaginary 
spectrum must be an odd function. We have now shown the following symmetry 
relationships for real signals: 


&e(t) real, even X (jw) real, even (9.55) 
Lo(t) real, odd X (jw) imaginary,odd. (9.56) 


These general principles are revealed by our observations of the transforms of 
certain signals. 


Example 9.4 
The rectangle fiinction is real and even. The same is true for its spectrum. 


rect(t) o—e si (5) (9.57) 
Example 9.5 
The real and odd function of time + has an imaginary and odd spectrum. 


] 
oe gmsign(w) (9.58) 
as 


9.5.4 Symmetry of Imaginary Signals 


The same deductions for time signals with real values can also be made for 
imaginary time signals. The equivalent relationships to (9.55), (9.56) are 


x, { t imaginary, even X (gw) imaginary, even | (9.59) 
x(t) imaginary, odd X (jw) real. odd. (9.60) 


The imaginary function x(t) and its real imaginary part Im{x(t)} should not be 
confused. For purely imaginary functions x(t) = jIm{a(t)}. 


9.5.5 Symmetry of Complex Signals 


The previous results for real arid for purely imaginary signals can now be 
united to give the symmetry for general complex signals. Every signal can 
be split into its even and odd parts, and its real and imaginary parts, and 
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this gives four tcrrns in total] for the time signal, and also the spectrum. The 
symmetry relationships (9.55), (9.56) for real signals can be used for the real 
part, and (9.59), (9.60) for imaginary sigiials can be used for the imaginary 
part. The scheme (9.61) can be formed from these, for tlie symmetry betwccn 
real and imaginary parts of the even and odd parts of a timr signal and spec- 
trum {19}. Although the symmetries seem to get more and more complicated, in 


fact, tlie general complex case is surprisingly simple, logical, and easy to remeniber. 


a(t) = Re{a.(t)} + Re{z,(t)} + jlm{x.(t}} + jlm{x,(t)} 


ee (9.61) 


X (jw) =Re{Xe(jw)} + Re{ Xo(gw)} + jlm{Xe (jw) } + jlm{Xo(jw)} 


Example 9.6 
A complex signal x(t) has the Foirier transform X(jw). What is F{z*(t)}? 
It can be taken from (9.61) that changing the sign of the imaginary part in the 
time-domain lias the following effect in the frequency-domain: 
Flax" (t)} =Re{X-Gw)} —Re{ X.(jw)} — jlm{X_(jw)} + jIm{X.(jw)}. 
Using the symmetry of the even and odcl parts this can be written more concisely: 
Flat(t)} =Re{X.(-jw)} + Re{ X_(—jw)} — jIm{X.(—jw)} ~ jlm{X.(—jw)} 
= X*({(—jw). 
Equation (9.61) yields the important transforni pair 


a*(t)o--eX*(—jw) 


9.6 Inverse Fourier Transform 


The inverse of the Fourier transform is an integral expression that ha:, a lot d 
similarity with the Fourier integral (9.1): 


eae Paces = [ x(jwet"a. (9.62) 
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The cause of this similarity is that both the time and frequency param 3ters are 
real values. ‘Che significant differences between the transform and its inverse are 
the intcgration variables (time / frequency), the sign in front of tlie exponential 
function (—/+) arid the factor 1/27 before the integral. Like the inverse Laplace 
transform, the inverse Fourier transform can rcprcsent a superimposition of eigen- 
functions e?“! of an LTI-system, but in this case only undamped oscillations are 
permitted. 

In fact, (9.62) can be interpreted as an inverse Laplace transform (5.384) for 
which the imaginary axis s = jw has been chosen as the path of integrntion. This 
interpretation is valid if the conditions for X(s) = X(jw)|,=,. (9-9) are fulfilled; 
the region of convergence for X(s) encloses the imaginary axis and X (jw) can be 
differentiated any nurnbcr of times. 

To verify that (9.62) actually yields the corresponding function of time for a 
possibly discontinuous spectrum X (jw), we put the definition of X (jw) into (9.62) 
in accordance with (9.1), and exchange the sequence of integrations. There is an 
expression (in square brackets} within the outer integral that we can interprel 
(see Section 9.4.3) as a delta impulse shifted in the time-domain. In contrast 
to Section 9.4.3, the roles of w arid ¢ have been swapped. With the selectivr 
property, we end up with z(t). Thus we have seen that the integral in (9.62) leads 
to a function of time from which _ (9.1)) X(gw) can be calculated. 


1 oO 
ae " X(jwe?' du = al Jo e I8F deel? dy = 
a f-OXS OO 


= x(t) (9.63) 


This derivation requires that both improper integrals can be swapped, which 
is tlie case for normal convergence of intcgrals. 

Just as for the Laplace transfoim, tlie assignment of a time signal to its Fourier 
transform is unambiguous, if discontiriuities are foreseen and dealt with (Chap- 
ter 4.6.2). Deviations at individual points d cliscontiniiities do not change tlie 
value of the integrals in (9.63), and when solving practical problems, this degree 
of unarobiguousness is sufficient. 


9.7 Properties of the Fourier Transform 


As well as the symmetry properties that we have already dealt with, the Fourier 
transform has many properties that need to be known to take advantage of the 
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enomtminame 


frequency-domain representation, without having to solve integrals over and over 
again. 
9.7.1 Linearity of the Fourier Transform 


It follows directl, from tlie linearity ofthe integration that the principie of super- 
position applies to the Fourier transform and its inverse: 


Flaf() +b} = aF{f}+oF{9(0)} 
FoF (jw) +dG(ju)} =e FF jw)} +d FG). 


i 


(9.64) 


il 


a, 6, cand d can be any real or complex constants. 


Example 9.7 


Tire Fourier transform of a delta impulse pair as shown in Figure 9.12 can be 
obtained as the sum of the transforms of two individual impulses that are each 
shifted by +e: 


O(E+ ct) +6(t— 7c) oe eI 4 e1¥% — Qeoswr. (9.65) 
ss 8 


x(t) X(ja) 


~T Tv t 


Figure 9.12: The impulse pair arid its Fourier transform 


9.7.2 Duality 


Because of the similarity between the formulae for the Fourier transform and its 
inverse. a correspondence between the frequency-domain and time-domain can 
be derived by carefully choosing the arguments of a given transform pair. With 
appropriate subtitutions into the integrals for the transform and its inverse, it can 
be shown that for two functions f; and f2 that 


filt) oe folw) 


fo(t) o—e 22rfi(—-w). (9.66) 


This relationship is called duality. 
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Example 9.8 
Using the property of duality we can obtain from the relationship (9.23) 


rect(t) o—e si @ 
that we already know as the transform pair for a rectangle-shaped spectrum 
.f t P 
= silz] oe 2nrrect(—w) = 2rect(w). (9.67) 


Figure 9.13 shows the duality between the si-function arid the rectangle function 


rect(t) 


Figure 9.13: Duality of the si-function and rectangle function 


Example 9.9 


From (9.65) we obtain using the duality property of the Fourier transform of 
a sinusoidal function of time: 


COs wot o—e r[d(w two) $h(w — wo)] : (9.68) 


The Fourier transform consists of a pair of delta impulses. For such functions of 
time there is a Fourier transform, but no Laplace transform. This is because there 
is no analytical continuation into the complex s-plane for the delta impulses on 
the imaginary axis. - 
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9.9.3 Similarity Theorem 


We saw when dealing with rectangle functions that thin rectangles have wide 
spectra, arid vice versa (Figure 9.7). This is also true for all functions of time and 
their corresponding spectra. 

The substitution ¢’ = at and u' =w/a in thr integrals of the transform arid 
inverse transform show that compressing the time axis corresponds to expanding 
the frequency axis, and vice versa. The factor a may be negative, but not complex-: 


a 


z{at) o--« e x(#) aeElIR\iO}. (9.69) 


This theorem has an important impact on the so-called ‘time-bandwidth product’, 
which will be discussed in Section 9.10. 
9.7.4 Convolution Theorem of the Fourier Transform 


As with the Laplace transform. convolution corresponds to multiplication of the 
Fourier transforms: 


OO 


y(t) = x(t)*h(t) = fa(ch(t— cde 
o (9.70) 
Y(Qqw) = XGw) Hw) 


The proof is carried out in much the same way as for the convolution property for 
the Laplace transform (compare Chapter 8.4.2). 

The most important use is the calculation of the output signals of LTL-svstems, 
The Fourier transforms of the impulse response is called the frequency response. 
Figure 9.14 shows the relationship bet ween convolution with the impulse response 
and multiplication with the frequency response. 


Example 9.10 


As an example for the use of the convolution property, we find the Fourier 
transform of the triangular impulse shown in Figure 9.15, which is defined as a 
function of time by 


t+1 for ~1L<t<0 
a(t)= 4 -t+1 ford<t<1 (9.71) 


0 otherwise 


Calculating the Fourier transform X (jw) =F {z(t)} with the Fourier integral is 
indeed not so difficult. but it is somewhat tedious. It is much simpler to notice that 
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1 


Figure 9.15: Triangular impulse 


a triangular impulse is the result of the convolution of two rectangular impulses. 
With Figure 9.16 this can he easily confirmed by inspection. This connection can 


i i 
BS = 
“12 1/2 t “1/2 1/2 t 


Figure 9.16: Triangular impulse as yielded by tlie convolution of two rectangular impulses 


also be expressed by (9.72). 


rect(t) * rect(t) = 2(t) (9.72) 
o oO oO 
| J l 


(3) «(5) = X(jw). (9.73) 


With the convolution property, (9.73) follows immediately. The Fourier transform 
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we were looking for is already there: 
X (jw) = si? (= (9.74) 


Figure 9.17 shows its plot. As the triangular impulse is real and even, its spectrum 
has the same properties because of the symmetry relationships. 


| X(ja) 


ins Sa / ‘ oes ee a a 
-4z, -22, 2 An 49) 


Figure 9.17: Fourier transform of the triangular impulse 


9.7.5 Multiplication Property 


By using the duality of F und F~! (9.66), we obtain from the convolution property, 
the relationship for the Fourier transform. of a signal y(t), that can be written as 
the product of two signals f(t) arid g(t), 


y(t) = f(t)- g(t) 
i (9.75) 
¥(ju) = 5-F Qe) # Gu) 


as convolution of the spectra F(jw) and G(jw). 


Example 9.11 


As a more detailed example, we consider a typical spectral analysis problem. 
The spectrum of two superimposed sinusoidal signals with almost the same fre- 
quency is to be represented in such a way that both signals can be easily distin- 
guished in the frequency-domain. The signal can only be observed for a limited 
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duration, and we wish to determine for how long it needs to be observed for us 
to able to distinguish the two signals from each other. Figure 9.18 shows the two 
signals whose superimposition we will be observing from time -T'/2 to T/2. 


Figure 9.18: Sinusoidal signals gi(¢), g2(¢) and the window of observation f(t) 


We already know that the spectrum of a sinusoidal signal consists of two delta 
impulses on the frequerrcy axis. The location of the impulses corresponds to the 
frequency of the signal. As both frequencies arc almost the same, the delta im- 
pulses will lie close to each other: 


g(t) = gilt) Fae(t) = coswyt + cos wat 


to) 
{ 
e 


(9.76) 
G(jw) = 7 (50 = ay) b(w + wi) + b(w — We) + b(w +0) F 


The finite observation time can be expressed mathematically as multiplication by 
a rectangle funetion in the time-domain. The function describes the finite window 
of observation through which we see the sinusoidal function. 


f(t) = rect (*] o—e F(qw) = ra‘) (9.77) 


We already know the spectrum of the window: a si-function. The observed signal 
is thus 

y(t) = f(t)-9@) =f) Lo) + eM, (9.78) 
as shown in Figure 9.19. Tlie spectrum actually observed can be represented with 
the multiplication rule, as the convolution of the spectrum G(jw) which contains 
the ideal delta impulse with the spectrum of the window of observation. Because 
of tlie convolution with four shifted delta impulses, the spectrum of the measured 
signal contains four terms that each have the same form as the spectrum of the 
window of observation and are located at the signal frequency. 


. 1 
¥(Ujw) = af iw) * GGw) (9.79) 
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Figure 9.19: Signal y(¢} weighted with the observation window 


= - i(w-av5 +a((ero5) 
“a(eneil) vo(ovn8) 


Figure 9.20 shows the spectrum of the reference signal for three different widths 
of the window od observation. From the similarity property we know that the 
wide: the window, the thinner the spectrum of the window, that means the longer 
the duration d measurement. A window of observation with length T = 1.2 has a 
spectrum wide enough so that the components of both frequencies can no longer be 
distinguished from each othei, and appear as a single signal. The two components 
first start to become distinguishable at a window width of T = 1.5, but are still 
not recogniseable as two separate impulses. Only by significantly increasing the 
duration of measurement, for example, to T = 10, can the two signals be clearly 
identified. At least several periods of the frequency difference between the two 
signals must be observed for them to be spectrally separated - 


9.7.6 Shift and Modulation 


If we set one convolution partner equal to J(t — c) in the convolution theorem 
(9.70), we obtain the shift theorem with w(t) * d(¢ — tT) =a(t — zc): 


a(t — ct) 0-0 e J" TX (Gu) . (9.80) 


Example 9.12 


In Figure 9.21 (top), the equation x(t) =si(mt)o -@X(jw) =rect(s-) is shown, 
The Fourier transform of x(t — 1) and x(t — 5) can be given directly by the shift 
theorem: 


si(a(t — 1)}) o—ee %”. rect (=) (9.81) 
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Y(jw) 


Figure 9.20: Spectrum Y (jw) for various observation windows 


and 
si(a(t —5)) o—e eP" -rect( ——). (9.82) 
n 


Both pairs arc likewise illustrated in Figure 9.21 (centre and bottom). 


The above example shows an interesting property of the shift theorem: shift- 
ing the signal does not change the magnitude spectrum. as the spectrum is only 
multiplied by a complex exponential function. 

A shift in the frequency-domain is described by the modulation theorem 


el#ot a(t) o-~e X(j(w — wo)) (9.83) 


where the multiplication of « time signal with a complex exponential function is 
known as modulation. The modulation theorem is a special case of the multipli- 
cation theorem (9.75) for multiplication with 


clot o_@ Qrd(w _ wo). (9.84) 
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X(t) = si(st t) |X(ja)| arg {X(j@)} 


: | 
nal anes is ig Neotel to 


10 # ml ci 


Si 
= 


X,(t) = si( (-1)) 


arg{X,(j@)} 


7 


(a 
~at = ow 
Figure 9.21: Example of the shift theorem 
x(f) = si(t) X(jw) =a rect(>) 
a4 
+. eal 
-1' 1 wo 


X(jm) =a rect(2=4) 


Figure 9.22: An example of the modulation theorem 


Example 9.13 
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Figure 9.22 illustrates the effect of modulating the signal x(t) = si(t) with e/™'. 
The time signal is complex after the modulation, so its real part is represented 
by the solid line (-), and its imaginary part by the dotted line (——). Note that 
a modulation with frequency jw) = 74 corresponds to shifting the spectrum by 
wo == 4 to the right. 


9.7.7 Differentiation Theorem 


As with the bilateral Laplace transform. there is a differentiation theorem for 
both the time-domain and frequency-domain. Differentiation in the time-domain 
corresponds to convolution with d(t): 


a = x(t) * 5(t) (9.85) 


With the transform pair F{é(t}} = gw (derivation in Exercise 9.13) and the con- 
volution property we immediately obtain the differentiatzon theorem 


a(t 
a ) oe jwX (jw). (9.86) 


As might be expected, it, can be derived from the differentiation theorem of the 
bilateral Laplace transform (compare Chapter 4.7.4) by substituting s with jw. 
This requires ::(t) to be differentiable. 

The differentiation of the Fourier spectrum corresponds as with the Laplace 
transform to a multiplication of‘the time signal with —f (compare Chapter 4.7.7): 


dX (jw) 
(gu) 


ta(t) o-—e : (9.87) 


‘This theorem is therefore also called ‘multiplication with t’ It can easily be demon- 
strated by differentiating the defining equation of the Fourier transform (9.1) with 
respect to jw (see Exercise (3.14). Note that, it must be possihlc to differentiate 
X (jw). 


9.7.8 Integration Theorem 


Here we are only interested in integ: ating in the time-domain. This corresponds 
to a convolution with the unit step function 


[ a(r)dz= x(t) * e(t). (9.88) 


OO 
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To derive the theorem we need the transform F{e(t)}, which is easy to calculate 
if we split ¢(¢) into its even and odd parts: 


1 1 
elf) = — —io . 9.89 
(t) 5+ 5 sign(t) (9.89) 


Using the principle of duality and the transform pair 6(¢)o--e1 (9.16) and 
foe ~ jrsign(w) (9.39), the even term is obtained as 


\3| = 7d(w) (9.90) 


F{jsen(| = ay (9.91) 


arid the odd terin as 


Jw 
Thus ; 
E(t) o—e 7d(w) + —, (9.92) 
jw 


and using the convolution theorem, we finally reach the sntegratzon theorem 


t 1 t 
| | a(c)dz oe X(jw) on x eer 


The integration theorem of the Fourier transform cannot be obtained simply by 
inserting 5 = jw inte the integration theorem of the Laplace transform (4.27). 
The form thus obtained is incomplete and is only valid for signals with zero mean 
X(Q) = 0. In fact, the imaginary axis according to (4.27) is not part of the region 
of convergence of the Laplace transform, as integration generates a pole at + =O. 
(9.93) can therefore not he analytically continued since it contains a delta impulse 
at w = Q for signals with a non-zero mean. 


9.8 Parseval’s Theorem 


A further property of the Fourier transform expresses Parseval’s theorem. It says 
that the integral of the product of two functions of time can also be expressed 
as the integral of the product of their spectra. To derive this theorem we start 
with the multiplication theorem (9.75) and write out the Fourier integral for ttic 
functions of time and the convolution in detail 


Roe ikags , L eS 
[ F(t)g(the""at = ra [ Fv)G(jw -- jv\dv . (9.94) 
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For w = 0, the exponential term on the left side of the Fourier integral disappears 
and 


f teoama = 5 [ FGu)G(-ivye (9.95) 


00 


For the functions of time f(t) and g(t) we will also permit complex functions. We 
can read from the symmetry property (9.61) and Example 9.7 that for a signal 
g(t) and the corresponding complex conjugate signal g*(¢) that the relationship 
between tlie spectra G'(jw) arid G* (jw) is 


gt) oe  Gw) 
(9.96) 
g(t) o-e G*(—jw) 


From here we ran obtain the general form of Parseval’s theorem for complex func- 
tions of time 


| i Ft)g° (dt = 5 | F(jv)G*(jv)dv | (9.97) 


For g(t) = f(t), we obtain the easy to remember relationship 


fis@Prae= 5 [row Pae. (9.98) 


To interpret this formula we define the energy of a time signal. 


Definition 15: Energy of a time signal 
The energy Ey of a sagnal f(t)is gwen by 


By = f \p@pat. 


The reason that this integral is called the energy of a signal becomes clear 
when we imagine f(t), for example, to be a decreasing voltage across an ohmic 
resistance. The energy converted to heat in the resistance is proportional to the 
integral over the square of the voltage Using the magnitude squared permits the 
use of complex signals. 

Parseval’s theorem says that the energy of a time signal can be calculated not 
only in the time-domain, hut also in the frequency-domain, by integrating the 
magnitude squared spectrum. Only the magnitude is involved; thr phase clearly 
has no effect on the energy of the signal. 
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Example 9.14 


As an example of the use of Parseval’s theorem, we will calculate the energy 


E, of the signal 
ce «(5) (9.99) 


Calculating the integral 


ec oo F oo Losi 24/2) 

on ENTE a ee A+ sin*(t 

Ly = | a*(t)dt = ic (5) dt if a dt 
oO oO ayes 


directly in the time-domain is possible, but requires some tricks and rearrange- 
ments. With the transform pair. (9.67) 


(5) o—e 27 rect (w) (9.100) 


and Parseval’s theorem we can calculate the energy much more easily in the 
frequency-domain by integrating the rectangle function: 


=k [xin d= Lf emPaw=2 (9.101) 
fa = 5 i qw a a Tw)" dw = 27. 9. 


We have used the fact that tlir square of a rectangle function is again a rect- 
angle. 


9.9 Correlation of Deterministic Signals 


The concept of correlation actually originates from random signal theory, which 
we will introduce in Chapters 17 and 18, where it, will play a central role. So far 
we have not encountered random signals, and we would like to emphasise that the 
following discussion is first of all limited Co deterministic (non-random) signals. 

Combining two functions of time f(t) und g(t} can be more generally formu- 
lated than in (9.97). If we consider the product of f(t) and g(t), shifted in time by 
z, the integral expression formed is a function of the separation in tiinr 7. This 
leads to the definition d the cross-correlation function 
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9.9.1 Definition 


Definition 16: Cross-correlation function 
The cross-correlation function of two deterministic signals f(t) and g(t) 2s 


Pfg(t) = [tes tg*(t)dt . (9.102) | 


—oCoO 


Definition 17: Auto-correlation function 


For f(t) = g(t) the auto-correlation function of the function of teume f(t) 


pple) = / fe + z)f* (edt (9.103) 


The cross-correlation function describes how two signals are related. while bear- 
ing in mind any possible displacement, The auto-correlation function shows how 
similar the components of a time signal are that occur at different points in time. 
We will come back to this later, when we have extended (9.102) to cover random 
signals, but the significant properties are already clear for deterministic signals. 


9.9.2 Properties 
9.9.2.1 Relationship with Convolution 


The integral expression in the definition of cross-correlation (9.102) is certainly 
related to the convolution integral. In fact, (9.102) can be changed to a convolution 
with the substitution t’ = ~f 


ee) ox 


prez) = f $(t-+ ag" (Hat = i f(e—t)g"(—t)de 


The cross-correlation function for deterministic signals can therefore also be de- 
fined by a convolution 


OO 


ajale)a f S(e-r 2)o"(Odt = fle) 9°(—2). (9.104) 


—o 
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Likewise for the auto-correlation function 


pyle = f fer oF Odt= 10) F(-0)- (9.105) 


oO 


Example 9.15 


What is the cross-correlation y,, (7) between the output and input of an LI'L 
system with impulse response h(t)? 
Evidently, 


y(c) * e*(—z) 

h(t) ‘ a(z) xa*(—c) 

= h(t) * ~rx(Z) 

The cross-correlation between the output arid input of an LTl-system is the same 


as the convolution of the auto-correlation of the input signal. and the impulse 
response. We will consider an example, with a delay circuit such that 


h(t) = O(t = ty) 5 
where the cross-correlation is a shifted version of the auto-corielation 


Pyx(T) = O(c — to) * Pra(T) = Yoa(t — to). 


Pyx( a) 


9.9.2.2 Symmetry 


The question of the symmetry of the cross-correlation fiinction is closely related 
to interchanging the two functions f(£) and g(t), because a shift of f with respect, 
to g by z is equivalent to a shift of g with respect to f by —c. Exchanging / arid 
g in (9.102) and substituting variables yields 


Pfg(t) =5s(~7) . (9.106) 


Clearly, ~yg(z) can only be expressed by yyy and not, by Pg itself. ‘The cross- 
correlation function therefore has no general symmetry propertics. 
For f(t) = g(#), it follows from (9.106) for the complex cross-correlation func- 
tion 
vse e) = 95 s(—7) (9.107) 
and for a real function of time f(t) 


pst) =9ry(-2) . (9.108) 
The auto-correlation of a complex function of time therefore has conjugate sym- 
metry; the auto-correlation of a reel function of time is an even function. 
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9.9.2.3 Commutivity 


While investigating the symmetry properties of the cross-correlation function we 
found a close relationship with exchanging the time functions From (9.106) it can 
be immediately read that in general 


Ppglt) # Pop(C). (9.109) 


This means that in contrast to convolution, the cross-correlation is not commuta- 
tive 


9.9.2.4 The Fourier Transform of the Cross-Correlation Function 


‘Che Fourier transform of the cross-correlation function can be most elegantly de- 
termined from the convolution relation (9.104). We need for this a special sym- 
metry df the Fourier transform, that as with (9 96), we can read from the general 
scheme (9.61) 

g(t) oe = G(jw) 


(9.110) 
g*(-t) 0-8 G*(jw) 
With the convolution theorem it follows from (9 104) that 
Pfy(t) = f(z) Sa g*(-z) 
oO 1) Oo 
e 00 é r 
Pw) = FigeZt)} = i wrg(tie de = Fw) + G*(jw) 
OO 
(9.111) 
or concisely, 
[eia(z) oe Fljw)G*(jw) . | (9.112) 


For the Fourie: transform of the auto-correlation function this expression can be 
simplified to 


lepp(t) o—* IFGu)P ae 


Example 9.16 


Generalising Example 9.14 we try to calculate the auto-correlation of x(t) = 


si (5) (9.99). Evaluating the integral 


Yee(T) = ‘ a(t-+ c)x(t)dt = / si (4 “) si (5) dt 


—OO OO 
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18 again so complicated, however, that we would like to find an easier way. 

We can read from (9.113) thai the Fourier transform of our auto-correlation 
function is already kiiown from the Fourier transform of the si-function. The 
auto-correlation function rx (z) then follows by inverse transformation 


Fives (= |X(jw)|? =  4rrect(w) (9.114) 
; 
§ c 
usa = 2nsi (5) (9.115) 


To check the results we consider the value at z = 0. Here, the value of the 
auto-correlation ~.(0)is the same as the energy E, of the signal x 


oO oO 
Gee (0) = / e(t)x* (t)dt = | je(t)|?dt = BE, 
~ oC 00 


From (9.115) we obtain with y, ,(0) = E, = 27 the same value that we had 
determined in (9.101). 


9.10 Time-Bandwidth Product 


At various times we have seen that there is a close connection between the duration 
of a signal and the appearance of its spectrum. In Figure 9.18 we made good use 
of this property to determine how long we needed to measure in the time-domain, 
to get a clear result in the frequency-domain. This reciprocal connection between 
the length of the signal in time and the width of the spectrum is clearly not limited 
to the rectangle function. Tle similarity theorem (9.69) says that a stretched time 
signal corresponds to a compressed spectrum (arid vice versa), for any time signal. 

We now wish to investigate this connection more closely. We are especially 
interested in the relationship between the period of a signal in time and the width of 
the corresponding spectrum. The width of the spectrum is known as the bandwidth, 
but we must make it clear what exactly should be understood by the terms period 
and width. 

In Figure 9.7 it is evident what is meant by the duration of a rectangle function. 
The corresponding spectra are all, however. stretched out, infinitely. Despite this, 
the spectrum of a rectangle function does seem to become wider, in a certain way, 
when the impulse becomes shorter. There are various possiblities to define the 
length of a signal and its bandwidth for general signal. We will consider three of 
them, and will see that they all lead to the same fundamental principle. 
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9.10.1 Equal-Area Rectangle 


The first method for defining the duration of a signal and its bandwidth is shown 
in Figure 9.23 for a signal a(t) that is real and symmetrical. Consequently, the 
Fourier transform F’{a(t)} = X(jw) has the same properties. We understand the 
duration 1; of a signal x(t) as the duration of a rectangle function that has the 
same area and height as a(t )itself If the time zero is chosen so that it coincides 
with the maximum value of x(t) then the height of the rectangle function is equal 
to x(0). From the equal-area requirement for the signal x(t) and rectangle of width 
D, and height (0) 

i n(t)dt = D,2(0) 

00 


we directly obtain the signal duration Dy, 


1 oO 
D, = ay | set (9.116) 
Neamt, sont” 
X(0) 


The area, under the signal x(t) cannot only be determined by integration, but also 
by reading the value of the spectrum at w = 0. This is 


X(Q) = [ aemtat | = [ seeae. 
ee age 8 


The signal duration can therefore also he expressed simply by the ratio 


Figure 9.23: Duration D; and bandwidth By, 


We understand the width B, of a spectrum X (jw) as equivalent to the width 
of it rectangular spectrum, that has the same height and area as X(jw) itself. 
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Proceeding iu the same way as before, we can obtain the bandwidth By as 


1 oO 
- iy 9.117 
B= qj | XO ma 


EE 


2% £(0) 


The area under the spectrum X(jw) can also he expressed by the value of the 
signal «(t) at t — 0. and it is then 


x(0) = = X{awijet*" dus yw) dw 


For the bandwidth B, therefore, 


(0) 
By = Qe. 
Pe £0) 
Duration D, and bandwidth B, clearly have a reciprocal relationship, so for their 
product 


dD; By, = 2n. (9.118) 
The product DB, of duration and bandwidth is called the tume-bandundth product. 
From (9.1 18) we can see that: 


| The time-bandwidth product is constant. 


This is true fur the definitions of duration and bandwidth that we have chosen 
here: equal-area rectangles for all real and symmetrical time signals. 


9.10.2 Tolerance 


A differcnt possibilty for defining the duration and bandwidth uses tolerance pa- 
rameters. Figure 9.24 shows examples fox a signal and its spectrum. Outside 
of the duration Dg, the magnitude of the signal x(t) is always less than g-times 
(0 <q < I) its maximum value: 


|z(t)| <q max|x| -Vt ¢ (to, to + Do] . (9.119) 
The bandwidth By is defined accordingly 


By 
|X (jw)| Sy max|X(jw)] Vel > >. (9.120) 


Tolerance parameters of this kind are common in filter design. They permit 
general statements to be made about a signal or its spectrum, even when the exact 
behaviour is unkown. From the similaiity theorem, the time-bandwidth product 
D2 By for a certain value of g only depends on the form of the signal x(t). A fixed 
value or lower limit is unknown in this tase 
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[XGo)| 


Figure 9.24: Example of tolerance parameters 


Example 9.17 


Signals of the form 
x(t) _ eee 


are called Gauss impulses. Theit transform pair is (see Appendix Appendix B.3) 


2,2 7 w 
ees 6 ar (9.121) 
From the condition 
Boa (22/2)? _ q 


we obtain 


Note that Ing is negative. 


~@ 4a 
[aa Om 


VT _ (Ba/2)? Jn 


By = 4da/— Ing 
arid for the the time-bandwidth product, the value 
Dz Bo = —8ing % 


is constant for any given q. If g is made smaller, the tolerance parameters become 
stricter, and the resulting time-bandwidth product Dy By for Gauss impulses is 
increased. 
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9.10.3 Second-Order Moments 


A third method for defining the signal duration and bandwidth can be obtained by 
using second-orclermoments for the magnitude squared of the signal and its spec- 
trum. This definition is motivated by analogies with random signals or mechanical 
systems. 

For simplification, we normalise the signal x(t) that we are considering. sv that 
it has energy E, = 1. We are assuming that 


% 5, oe 
| lett) Pat = i 1X (jw) 2dw = 1. (9.122) 
-00 09 


The duration Ds can then be defined as 


/ (t ~ t4)2le(2)[2ae,, (9.123) 
where ss 
t, = / t|x(t)|Pdt (9.124) 


is the first moment of |x(¢)|? It corresponds to the centre of gravity in mechanics, 
if the time dependent variable is viewed as corresponding to position (e.g the 
distance along a beam), and |a(t)|? as density. In this analogy, (9.123) is the 
moment of inertia. If the reader prefers the probability theory analogy. |r{t)|* 
can be interpreted as the probability distribution independent of t, (9.124) as the 
mean arid (9123) as the standard deviation. 

The bandwidth B3 is defined by 


Bz = fw ~ wes)? , |X (jw) |2dw (9.125) 
oo 
with . 
Ws = [ o1xGw)Pau (9.126) 


Using Parseval’s theorem for |a(t)|? and |z’(t)|? and Schwarz’s equation, it can be 
shown [5], that the time-bandwidth product. is 


D3 Bz > 2 (9.127) 
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The exact value of Dz3B; depends on the form of the signal z(t). The minimum 
is found for a Gauss impulse [5]. Because of formal analogies with quantum me- 
chanics, this equation is also called the uncertainty relation. 

As a Gauss impulse has a particularly good time-bandwidth product D3 Bs 
(9.127), it is employed whenever it is important to pack as much energy as possible 
into a small frequency band over a small amount of time. This is, for example, a 
typical demand of a digital transmission system. In short-time spectral analysis, 
good time and frequency resolution is required at the same time, and Gaussian 
windows are widely employed. 


9.10.4 Summary 


From the various definitions of duration and bandwidth and the results obtained 
we can draw some important conclusions. 


Duration and bandwidth of a signal are reciprocal. It is therefore not possible 
to find a signal that has any desired short duration and at the same time any 
desired srnall bandwidth. Shortening the duration of the signal always increases 
the bandwidth, and vice versa. 

This statement is very important for signal transmission and spectral analysis 
(see Example 9.11). It is formally related to the uncertainty relation from quantum 
mechanics. 


9.11 Exercises 


Exercise 9.1 
Calculate the Fourier transforms of the following signals with the Fourier integral. 
as long as it converges. For comparison, give also the Laplace transforms with the 
regions of convergence. 

a) z(t) = e(t) e408 

b) x(t) = rect (0, 1¢) 

c) a(t) = 6(—4¢t) 

d) a(t) = e(—t) 

e) z(t) =e Ie" 


Note: b) Properties of the Laplace transform are in Chapter 4. c) Rules for 
calculations with the delta impulse are in Chapter 8.3.4 
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Exercise 9.2 


For which parts of Exercise 9.1 can the Laplace transform be used to calculate the 
Fourier transform (see equation (9.9))? Justify your answer. 


Exercise 9.3 


Give the Fourier transforms of the signals in Exercise 9.1, whose Fourier integrals 
do not have convergence, using generalised functions. You will find some already 
known transform pairs and some properties of the Fourier transform useful. 


Exercise 9.4 


1 
Evaluate F { =} using the Fourier integral (9.1). 


Note: See Section 9.4.4 and use a suitable substitution. 


Exercise 9.5 
Let a(t) = si(wo?). 
a) Determine wo so that the zeros of x(t) lie at t=n-4a,n€ Z\ {0}. 
b) Calculate | a(t) dt. 
—00 


c) Sketch x(t) for this choice of wo. 


Exercise 9.6 

Evaluate the Fourier transform of «(t) = si(10x(t + 7)) and sketch for 7’ = 0.2: 
a) |X(jw)| and arg{ X(ju)} 
b) Re{ X(yw)} and Im{X (jw)} 


Note: displacement: rule. 


Exercise 9.7 


Find the functions of time that correspond to the following Fourier transforms: 


Mah & ojw +5 
(jw)? + 2jw +17 
: sin(2w 
Xo(ju) = SBee) 


Qu 


ow. = y= ) . 
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Exercise 9.8 


What symmetry does the spectrum have for a) a real signal and b) a purely 
imaginary signal? 


Exercise 9.9 


You are given the transform pair x(t)o—eX (jw) , x(t) €C. What are the Fourier 
transforms of a) ya(t) = 2(—t), b) yn(t) = z*(t) and c) y-(t) = 2*(—t), expressed 
with X (jw)? Use the symmetry scheme (9.61). 


Exercise 9.10 


The signal z(t) has spectrum X(jw). With amplitude modulation, y(t) = 
(a(t) + m) sin(wet). Give Y (yw) dependent ou X (jw) and sketch it. 
Xa) 


04 OO (4 7 aw 


Note: Analyse sin(wyt) with exponential oscillations and use the modulation the- 
orem. 


Exercise 9.11 


Caleulate Y(jw) from Exercise 9.10 with F{sinwt} and the multiplication theo- 
rem. 


Exercise 9.12 


Use the duality principle to help calculate 
a) F{rd(t) + 3} 
b) Fiza} 
c) Fi{sign(t)} . 


Note: the dual transform pairs can be found in Sections 9.2.2, 9.3 and 9.4.4. 


Exercise 9.13 


Confirm the transform pair 4(f) oe jw used in Section 9.7.7 (differentiation the- 
orem) by putting it into the Fourier integral (9.1). 
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Exercise 9.14 
Prove the theorem ‘multiplication with #’ (9.87) by differentiating the Fourier 
integral (9.1). 


Exercise 9.15 


Determine the Fourier transform of the triangular function shown 
a) by using the differentiation theorem of the Fourier transform, 


b) by multiplying the spectral functions of suitably chosen rectangle impulses, 
whose convolution gives the triangular function. 


x(t) 


This Page Intentionally Left Blank 


10 Bode Plots 


10.1 Introduction 


We have already pointed to the close connection between the Laplace transform 
and the Fourier transform, at the start of Chapter 9. In this chapter we introduce 
a classical method to determine the magnitude and phase of the Fourier transform 
of a signal from the pole-zero plot of its Laplace transform. It is mostly used 
to describe systems so that we can refer to the system function instead of the 
Laplace transform of the impulse response, and the frequency response instead of 
the Fourier transform. 

Bode plots are used as a fast way of finding the approximate frequency response 
from the poles and zeros of the system function. At one time, Bode plots were 
the engineer’s standard method for representing a frequency response in graphical 
form. They would always have logarithmic graph paper ready for this task, but 
of course, this is no longer necessary, as computers can draw frequency response 
plots faster and more accurately. Bode plots are, however, a marvellous way of 
developing an intuitive understanding of how the location of the poles and zeros 
of the system function affect the frequency response, and it is therefore important 
for developing and analysing systems. 

The fundamental connection ‘between the system function and the frequency 
response is given by the relationship (9.9), that we can also write here as 


FAN} = HW) = H(i = AO aye (10.1) 


As stable systems only have decaying oscillations, all poles must lie left of the 
imaginary axis of the s-plane. The imaginary axis s = jw is part of the region of 
convergence of £{h(t)}, so the Fourier and Laplace transforms can be set equal as 
in (9.9). Anyway, in Chapter 9, we had introduced the Fourier transform with jw 
and not w, so between the frequency response [1(jw) = F{h(t)} and the values 
of the system function H(s) = L{h(t)} for s = jw, we do not have to make any 
changes in the notation. 


Bode plots represent the frequency response as split into magnitude and phase 
H (ju) = |H(gw)|-@7°*) = |(jus)] - e7 ALTON) 


with the following properties 
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1. The logarithm of the magnitude |H(jw)| is plotted against the logarithm of 
the frequency w. 


2. The phase y(jw) = arg{H(jw)} is plotted linearly against the logarithm of 
the frequency. 


For transfer functions in rational form, approximate asymptotes for the plots can 
be drawn very quickly since from 


[Uw — Som) 


H(jw) = K+ , K>O 10.2 
SEE Te ae coe 


follows 
log |H(Qjw)| = > log jw—Som| ~- > log |jw — sy,|+ log K 
(10.3) 
p(w) = Slarg(jw— som) — Yo arg(jw — spn) 


The logarithm of the magnitude and phase can thus be separately determined for 
each zero and pole, and the individual magnitudes can be added together when 
drawn. A logarithmic frequency axis makes it easier to get an overview of multiple 
decades. Likewise, for reasons of clarity, the ordinates for log|H(jw)} are marked 
in decibels (dB), i.e., we write 20 logy, |H(yw)|. 

In the following sections, we will first show the representation of single poles 
and zeros, and then put the partial results together as complete Bode plots. 


10.2 Contribution of Individual Poles and Zeros 


We will start with an example, in which we wish to determine the contribution of 
a real pole at s = —10 with the frequency response 
1 


1 
(jw) = ——— = . 10.4 
(iw) gw +10 s+10 ( ) 


B= yw 


By substituting different values for w we obtain the value for |H(jw)|, arg{H (gw) } 
and 20 logy) |H(jw)|, from Table 10.1. The magnitude frequency response is shown 
in Figure 10.1, in linear and in double logarithmic representation. The linear 
representation shows neither the behaviour at low frequencies (0 < w < 10), nor 
the behaviour at high frequencies (w >> 10) particularly clearly. In contrast, the 
double logarithmic representation makes it clear that the magnitude frequency 
response can be approximated by two asymptotes: for w < 10 the magnitude 
frequency response is approximately constant and for w >> 10, it decays by 20 
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Table 10.1: Magnitude, phase and damping of H(jw) for various frequencies w 


E |H(jw)| | arg{H(jw)} | 20 logy) |HGe)| 
0 O.1 0 —20dB 
1 | 0,0995 —5.71° —20.04dB 
2} 0,098] —141.31° —20.17dB 
|H(jw)} linear 20 log) |H(yw)| logarithmic 
[dB] 4 
os -20 
-30} 
-40 | 
-50 
0 100 200 300 400 500. 101 109 101 102 103 


Figure 10.1: Linear and double logarithmic representation of the frequency response 


dB/decade. The frequency w = 10, where both asymptotes meet, corresponds to 
the magnitude of the pole at s = —10 on the real axis. It is also called the cut-off 
frequency of the system. 


The exact and the asymptotic behaviour below, at and above the cut-off fre- 
quency is summarised in Table 10.2 for a system with a real pole at s = —a. The 
system function is 

J 


H(s) = eae a>0 


The numerical values of the magnitude frequency correspond to the value a = 10 
from (10.4); the phase angle is correct. for any real poles. 

At w = 0 the frequency response is purely real and has the value H(0) = L = 
75, or in logarithmic form 20 log jy H(0) = 20 x (—1) = —20 dB. The phase angle 
is Q° 


At rising frequencies no significant variations from these values are obtained, 
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Table 10.2: Table of values of /7(jw), damping and phase 


Frequency H(jw) Damping Phase 


1 
_ —20 dB 
10 20 ¢ 


1 
w = 0 -= 
a 


w < O.la 


—20 dB 
—23 dB 
—20 dB/decade 


w > 10a 


to about w = 0.la At this frequency the phase has the value 
. wad O.la 5 
p(j0.la) = arg H(j0.1@) = — arctan ao arctan 0.1 = —6°. 
The magnitude of the frequency response first varies significantly from the value 
at w = 0 at the cut-off frequency w = a, and is given by 


1 L 1 
~ Vara Ba tO 
20 logy |H(j10)| = -3dB — 20dB = —23dB for a= 10. 


The phase here is 


| (ga)| 


: a 
y(ja) = — arctan — = ~ arctan] = —45°. 
ah 


ee ee m . 
For w > a the value of a* in the magnitude frequency response 


1 oe! 
Jae + wr a3) 
can be neglected compared to w?, so that it is then decaying reciprocal to w. 


In the double logarithmic representation, because of log|H(jw)| = —logw, 
a linear relationship between log |#H(jw)| and logw is obtained. Increasing the 


| (jw)| = 
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frequency by a factor of 10 (one decade) then leads to a reduction of log | (jw)| 
by 20 dB. The magnitude frequency response is said to decay linearly by —20 
dB/decade. 

The phase reaches the value 


10a. 
p(jl0a) = arg H(j10a) = — arctan a = — arctan 10 = —84° 


at w = 10a. For w — oo it becomes —90°, 
It is obvious that the shape of the magnitude frequency response and the phase 
can be described approximately by a few rules. 


e The magnitude frequency response is constant for frequencies below the cut- 
off frequency w = a, and afterwards it falls at -20 dB/decade. Its exact path 
runs underneath the asymptotes and its maximum deviation from them is 3 
dB, at the cut-off frequency of w = a. 


e The phase has the constant value 0° for w > 10a. Between w = 0.la and 
w = 10a, the phase decreases linearly with the logarithm of frequency. At 
the cut-off frequency the phase has the value —45° exactly. 


The greatest variation between the exact path and the asymptotic approxi- 
mation is about 6° and it occurs at w = 0.la and w = 10a. Figure 10.2 shows 
the asymptotic approximation (by solid lines) and the exact path (dashed lines) 
for @ = 10. The advantage of this representation is that the exact path can be 
sketched from the asymptotes and the known deviances at 0.la, a and 10a. 


magnitude phase 


20 log |A(ja)| arg {A(jo)} 


Figure 10.2: Bode plot for H(s) = aT 
8 E 


For a real zero, the same rules apply with a few deviations 


e The magnitude frequency response climbs above the cut-off frequency at 20 
dB /decade. 


® The phase climbs between w = 0.la and w = 10a from 0° to +90°. 


246 10. Bode Plots 


The plot for a real zero can be obtained from that for a pole by flapping the 
drawing along the horizontal axis. Figure 10.3 shows the corresponding runs for a 
zero at 8 = —a = —10, that is for a transfer function of the form H(s) =. + 10. 


magnitude phase 


arg {H(jo)} 


20 log |H(je)| 


ow 


Figure 10.3: Bode plot for H(s) = s+ 10 


10.3. Bode Plots for Multiple Poles and Zeros 


After the detailed examination of the contribution of individual real poles and 
zeros in the last section most of the work required to draw a Bode plot. for systeras 
with multiple poles and zeros has already been done. As systems with multiple 
real poles and zeros (10.2), (10.3) can be written as the sum of the contributions 
of the individual poles and zeros, we only need to determine the asymptotes for 
the poles and zeros and put them together to form a complete picture. 

We will explain the procedure for the system function 


8s + 1000 1 L 


Hf ne oe | Sere ay 
2) ioe eh Se 510 


The double pole will be treated as two simple poles. The cut-off frequencies are 
w = 1000 for the zeros, and w = 10 for both poles. Figure 10.4 above shows the 
logarithmic representation of the magnitude frequency response from the rules in 
the last section. The contributions of the poles correspond exactly to the system 
function (10.4), that we have already dealt with in detail. The contribution of 
the zero can be given immediately by turning upside down the contribution of 
the pole above. Because of the greater cut-off frequency of w = 1000 it is shifted 
two decades to the right. ‘The value of the constant asymptote can be most easily 
obtained for w = 0 to 20 log), 1000 = 60 dB. 

In Figure 10.4 below, the phase plots are shown. The phases of the poles here 
are also already known. The phase of the zero can be obtained, again by flapping 
the plot of the pole as above, and by shifting two decades to the right. 

If we add cach of the logarithmically represented magnitude frequency re- 
sponses and the linearly represented phases together, we obtain the complete 
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20 log |H(ja)| 


[0B] [dB) [dB] 
60 20+ 49 1000 @ 20; 190 1000 © 
40 | “ 0 font 0) 
20 | -20 -20 
0 -A0 -40 
pl 10 1000 @ oe me 
4 
gor t gor: 


+ 10 1000 oy 0° 10 1000 w 


perce Ninennaey waaneatalid Sonoran 


| 


| 


1 


-90°+ -90° 


Figure 10.4: Putting together a Bode plot for multiple poles and zeros. 


Bode plot, as shown below in Figure 10.5. The double pole as the sum of 
two simple poles leads to a decay of the magnitude frequency response by 
2 x (—20dB/decade) = —40 dB/decade, from the cut-off frequency of w = 10. 
In the same way the phase decreases between 0.1 x 10 = 1 and 10 x 10 = 100 by 
2 x 90° = 180° from 0° to —180°. 


20 log |H (qw)| arg{H(jw)} 


10 1001000 


_ s+ 1000 
~ (s+ 10)? 


Figure 10.5: Complete Bode plot for H(s) 


The zero is first noticeable in the Bode plot of the magnitude at the cut-off 
frequency of w = 1000. Its slope of 20 dB/decade added to the contribution of 
the double pole, —40 dB/decade leads to a decay of —20 dB/decade for w > 1000. 
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The increase of the phase of 90° between 0.1 x 1000 = 100 and 10 x 1000 = 10000 
leads to a total phase of —90° for w > 10000. 


10.4 Rules for Bode Plots 


We will now summarise the discussion about determining Bode plots with some 
simple rules for the magnitude frequency response and the phase. They apply 
to poles and zeros on the real axis of the left half of the s-plane. The distance 
separating them should be great enough so that they do not mutually influence 
each other in the region of the cut-off frequencies . We can see from our previ- 
ous discussion (see Table 10.2) that a factor of 100 is sufficient difference. The 
limitation to real poles and zeros has historical reasons. As Bode plots are very 
easy to draw under these conditions, they are the most widely used. Extension to 
complex pairs of poles and zeros is covered in further sections. 

The following rules also include the case where a pole or a zero lies at s = 0. 
In the logarithmic form of Bode plot, the cut-off frequency is not visible at w = 0, 
however, so only the contribution right of the cut-off frequency appears, that is 
the gradient of +20 dB/decade for the magnitude frequency response and +90° 
for the phase. 


10.4.1 Magnitude Frequency Response 
1. Determine the location and order of poles and zeros. 
2. Draw axes and plot cut-off frequencies. 


3. Start at small w: ; 
a) no pole and no zero at s = 0 — gradient 0 


b) pole at s = 0 — pradient -20 dB/decade 
c) zero at s = 0 > gradient +20 dB/decade 


For multiple poles or zeros use multiple gradients. 


4, Straight line to the next cut-off frequency. 


wri 


. Decrease by 20 dB/decade for each pole, increase by 20 dB/decade for each 
zero, then continue with step 4 until all cut-off frequencies have been finished 
with. 


6. Label the vertical axis: calculate |H(ja)| in a region where the Bode plot is 
flat. 


7. Round off cut-offs by +3 dB (or multiples of +3 dB for multiple poles or 
ZeTOS). 
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10.4.2 Phase 


1. Determine the location and order of poles and zeros. 
2. Draw axes and plot the cut-off frequencies. 


3. Start at small w: 
a) no pole and no zero at s = + phase 0 


b) pole at s = 0 -» phase —90° 
c) zero at s = 0 — phase +90° 


Multiple poles or zeros have multiple phase angles. Bear in mind that a 
minus sign before H(jw) is a phase offset of 180°. 


4, Straight line to 0.1x the cut-off frequency. 


5. Each pole subtracts 90°, each zero adds 90° in a region from 0.1x the cut-off 
frequency to 10x the cut-off frequency. Continue with step 4 until all cut-off 
frequencies have been dealt with. 


6. Smooth the phase sketch. Round off about 6° at 0.1x the cut-off frequency 
and 10x the cut-off frequency (or the corresponding multiples for multiple 
poles or zeros). 


10.5 Complex Pairs of Poles and Zeros 


For complex pairs of poles and zeros there are no simple rules as with real poles 
and zeros, because the cut-off frequency depends on both the real and imaginary 
part of the pole or zero. 

If the imaginary part is small compared to the real part, a complex pair of 
poles can be approximated as a double pole on the real axis, because then the 
cut-off frequency is almost exclusively defined by the real part. The equivalent, is 
also true for pairs of zeros. 

Tf, on the other hand, the real part of a pole is small compared to the imaginary 
part, the cut-off frequency depends almost exclusively on the imaginary part. 
The Bode plot with the corresponding cut-off frequency can be drawn as before. 
As we are dealing with two poles, this amounts to a gradient above the cut-off 
frequency of —40 dB/decade. The behaviour at the cut-off frequency depends 
ou the relationship between the real part and the imaginary part. A sufficiently 
large imaginary part in relation to the real part creates a resonance that becomes 
stronger as the pole nears the imaginary axis. The equivalent is also true for pairs 
of zeros. 
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Example 10.1 


As an example we will consider the magnitude frequency response and the 
phase for the system function 


1 
s7 4+ 0.48 + 1.04 


H(s) = 


with poles at 
s§=—-0.2+7. 
‘The exact behaviour is depicted in Figure 10.6. 


20 log |H(jw 
g | Gar) | Resonanz umso starker, 
“N aa «je naher Pol an imaginarer 
0dB cane sr tt sea A geet ae ote 3 Achse liegt 
oe | X40 dB / Dekade 
a. 
-40 d 4 i as — 
0.1 1 10 100 i 
arg {H(ja) } 
0.1 1 10 100 
o° tt + + (ry 
\ 
\} 
\ 
iN 
oe 
-180° SS Soe 


Figure 10.6: Bode plot for a complex pair of poles 


The cut-off frequency is in this case mostly determined by the imaginary part 
and is located at w = 1. To its left the magnitude frequency response is approx- 
imately constant at —20 log), 1.04 = 0 dB. To the right of the cut-off frequency 
there is a linear decay of —40 dB/decade 


1 
20 logy |H (jw)| + 20 logyo ao AD logigw . 


The form of the resonant peak depends on the distance of the pole from the 
imaginary axis. The phase decreases in the region of the cut-off frequency from 
0° to —180°, and the exact form of its path near the cut-off frequency must agai 
be determined by the distance of the pole from the imaginary axis. ™ 
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If either the real or imaginary part may not be neglected in favour of the other, 
there is no simple method of finding the cut-off frequency and drawing the Bode 
plot. We can in fact. look back at the equations (10.3) and determine the distance 
of the poles and zeros, and the corresponding angles graphically for each point of 
interest on the imaginary axis. Figure 10.7 shows the situation for a pair of poles 
and an arbitrary point on the imaginary axis. The distance to the poles and the 
corresponding angle can easily be read from the plot. 


4j@ 
rj 
meen ~+ fe 
-1 1 a 


es 


Figure 10.7: Pole-zero diagram for a complex pole pair 


Example 10.2 


As an example we will examine the system function 


1\2 
: (s + 5) 
(s+ $)(s? +24 8) 


H(s) = 


with the pole-zero diagram from Figure 10.8 


jo 
x9 


Figure 10.8: Pole-zero diagram for the given transfer function 


To estimate the magnitude frequency response we begin by considering the 
value of the contribution of the system function at w = 0. From the pole-zero 
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plot we recognise that at w = 2 there is a resonant point. We thus calculate the 
magnitude for this point from H(s). As the number of poles is by one greater 
than the number of zeros, the magnitude frequency response for w >> 2 falls at 
20 dB/decade. To confirm this we determine the magnitude at w = 10. In order 
to approximate the path more accurately, we calculate the value for w = 1 as 
well. The distances in equation (10.3) are calculated from the pole-zero plot. 
As is evident in Figure 10.9, the following approximate values are yielded, if the 


Figure 10.9: Estimating the lengths for various w 


distances of the zeros are multiplied and divided by the distance of the poles: 


Cee! 1 
[H(j0)| = Tuono = —27.6 dB 
ee a | 
Atl ved ete A OS —10¢ 
I) 15x1x3.3 dB 
4 
H(j2)| = ——————- = 16 3 4.1 dB 
| ©) | 25x4xi l C 
10 x 10 2 
[27 (710)| axe wo = —20dB. (10.5) 


For the phase plot we need the phase at w = 0 and recognise from the pole-zero 
diagram that due to the pole s = —} +23 the phase changes sharply around w = 2. 
Further, the phase of H(s) for w >> 2 takes a value of —90°. Considering this, 
we can estimate the phase at the following points with the pole-zero diagram, as 
shown in Figure 10.10. We obtain 


{| 


p(j0) 0 
y(j1) 2 x 60° — 30° + 90° — 90° = 90° 
v(j2) ~ 2x 80° — 50° — 0° — 90° = 20°. (10.6) 


v 


10.5. Complex Pairs of Poles and Zeros 


h jo 4 jo 4 jo 
360°-a Og 90° 0 
i 
ae 0° 30° 2-60° 502 ‘ 2-80° 
~< — Sag _ . 
(er oO 
Ng A 90° 
w=0 


Figure 10.10: Estimation of the phase for various w 


In Figure 10.11 our estimates are displayed with the exact frequency response 
|f[(yw)|. The estimates are marked as crosses. Likewise, our estimates of the 


phase as displayed with the exact values for comparison in Figure 10.12. 
20 log |H(jw)| 


\. 


20 dB / Dekade 


= oo 
10 100 
Figure 10.11: Exact magnitude and estimates for various w 
arg {H(jo)} 
4 
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Figure 10.12: Exact phase and estimates for various w 
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For second-order systems with a complex pair of poles very close to the imag- 
inary axis, the magnitude response can also be expressed directly by the denomi- 
nator coefficients. 

The pole-zero diagram for system function 

Pe 
s* + 2a8 + w? 


A(s) = 
with poles 
s=-atjB, a<p 


is shown in Figure 10.13. Under the stated condition a < 8 the denominator 
polynomial takes the form 


(8 +a —58)(s+a+ jf) = s? + 20s + (a? + 6?) © 5? +208 +8. 


The resonant frequency is 


wy & B. 


Figure 10.13: Pole-zero diagram with poles very near the imaginary axis 


The magnitude response plotted in linear form is shown in Figure 10.14 for a = 
0.1 and 8 = 1. This kind of frequency response occurs for all oscillating systems 
with low damping and is called a resonance curve . A measure for the resonance 
is the width of the resonance curve 3 dB below the peak. It can be confirmed that 
the end points occur at w & @-+ a@ and the width is therefore Aw = 2a. This 
can also be illustrated easily as in Figure 10.13, if a triangle is drawn between 
two points 6+ @ on the imaginary axis and the pole. A dimensionless quantity, 
known as the Q-factor is obtained by relating Aw to the resonant frequency wo. 
The Q-factor is given by 


pe Oia 
Oe oa" 
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Our example in Figure 10.14 has Q-factor Q = 5. The resonant peak lies at Q 
times the value of |I7(jw)| for w — oo. This can be clarified by Figure 10.13, where 
as in (10.5) for w = & the product of the disctances between the zeros (= 3 x 8) 
is divided by the product of the distances between the poles (& a x 2/). 
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Figure 10.14: Resonance curve of the system 


10.6 Exercises 


Exercise 10.1 


For the following system: 


How much amplification does the system have in dB, if 
a) ug = 10% 
b) wz = 107 uy 
c) ug = V2uy 
d) ug = 0.02 uy 


@) ug = -2u,? 


Exercise 10.2 
How much amplification in dB does a system have, if the output power is a) 64 


times or b) 2 times the input power (the input and output resistances are equal)? 
First calculate the relationship between input and output voltage. 
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Exercise 10.3 
: 1000 
Por H(s) = ——— 
ak seersreT 7) 
of H(s) in dB for the frequencies w = 10", k = 0,1,...,5. The complex values of 
H(s) values should be given in the form a+ 7b. 


calculate the the amplification of H(s) in dB and the phase 


Exercise 10.4 
s+l1 


s(s + 100) 
To find the appropriate scale for the amplitude axis, calculate the amplification at 
w = 10. 


Draw the amplitude and phase diagrams for the Bode plot of H(s) = 


Exercise 10.5 


Draw a pole-zero and phase plot from the following amplitude plot. 


20 log |H| 


0,1 if 10 100 10° wo 


Exercise 10.6 
A system has the impulse response A(t) = ! s(t) oe ely 
system has the impulse response h(t) = ~=-54(t) — go5 


a) Give H(s) and draw the Bode plot, i.e., amplitude and phase plots with 
appropriately labelled axes. 


b) Give the output signal y(¢) of the system for the input signal x(t) = cos(wot) 
at the normalised frequencies wo = 0.01,1,10 and 10°. 


Exercise 10.7 


a) Draw the amplitude diagram of the Bode plot for H(s) = ; use the 


Pe 
(e+ 10)" 
frequency w == 100 for labelling the axis. 


b) By what percentage does the exact amplitude differ from the one in the Bode 
plot at w = 100 and w = 1000? 
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c) By how many dB is it rounded off at the cut-off frequency w = 10? Exactly 
how much amplification is yielded at w = 10? Give the difference from the 
rounded value in the Bode plot as a percentage. 


Exercise 10.8 
2 
and H»(s) = a ee Where do the 


2 
Draw the phase plots of Hy(s) = aT (e+) 
2 + 


amplitude plots of H, and He differ? 


Exercise 10.9 
A system has the following transfer function: 


6? + 1.164+01 


H(s) = 10*. ~ 
(s) 53 + 1011s? + 11010s + 10000 


a) Draw the pole-zero plot for this system. 


b) Draw the magnitude and phase components of the Bode plot of H(jw) with 
appropriate labelling of axes. What behaviour does H(s) show? Read the 
maximum gain and the frequency or frequencies where the gain has fallen Lo 
a tenth of its maximum. 


c) Let the input signal of the system be x(t) = e(t). Determine the value of 
the output signal y(t) for t > co from an amplitude plot. 


Exercise 10.10 


Mark the cut-off frequencies in the following pole-zero diagram and draw the mag- 
nitude component of the Bode plot. Give H(s) and label the |H| axis so that 
jw 


_ 
2A - 16 o 


Exercise 19.11 


The gain of a system 


a) decreases reciprocally 
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b) increases linearly 
c) increases quadratically 
d) increases with order n 


_dB 
ecade 


Picante ence, aise ae eoeceponar to ie enieany cespoe: 


Exercise 10.12 


Give the gain |H| of the system from Exercise 10.5 at the frequencies w = 2,w = 
4.w = 8 and w = 2000. 


Exercise 10.13 


Give the gradients 205]. aB 40 ah and 60 $B in ins ae Note: octave signifies a dou- 
bling of frequency. 


Exercise 10.14 


Consider a second-order low-pass filter with cut-off frequency w. = 10* and a DC 
gain of 20 dB. 


a) Draw the amplitude component of the Bode plot with appropriate labelling 
of axes and give the corresponding transfer function Hyp(s). 


b) A first-order high-pass filter has been connected to the system, transforming 
it into a band-pass filter with the following characteristics: 


—~ max. gain 14 dB 
— gain of 0.5 at w = 10 


The high-pass filter has cut-off frequency w, and for w — oo, gain A. Give 
Hyp(s) and the corresponding amplitude component, then draw the ampli- 
tude component of the desired system and determine graphically from it the 
values of A and wy. 


Exercise 10.15 


The following is known about a system: 
e (Q-factor = 50, 
® maximum gain is 26 dB at wo = 10, 


e H7(jgw) increases for w < wy by 20 as and decreases for w — 00 by 20 ae . 
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Draw the amplitude component of the Bode plot. Label the axes as much 
as possible, 


Evaluate the transfer function H(s) with the permitted approximations for 
systems with resonance. 


Label the axes, using H(s) for w = 1 and w = 100. 
Draw the pole-zero diagram. 
At about which frequencies is the gain 3 dB below maximum? 


Under what conditions do we find |H(jw)| - oo? What condition of a real 
system does this correspond to? 
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11 Sampling and Periodic Signals 


11.1 Introduction 


The continuous signals dealt with in previous chapters occur in natural and tech- 
nical processes, where time (or position) is a continuous variable. To record and 
process these analog signals with a digital computer we need to convert them to 
digital signals. This is carried out with an analog-to-digital converter (ADC) in 
two distinct steps. 


e Sampling of a continuous-time signal x(t) at equidistant time points sepa- 
rated by a time T (time quantisation). 


alk] =2(kT), kez. 


e Storing the sequence of values z[k] in memory cells with a finite number of 
bits (amplitude quantisation). 


The square brackets in z[k] indicate that it is a discrete signal, i.e., a sequence of 
numbers. The time T between two sequential samples x(kT) is called the sampling 
unterval. 


We are only concerned here with the first step, the sampling, or time quanti- 
sation. Amplitude quantisation is non-linear, because the amplitude is rounded 
to a finite word length. For computers with a sufficiently great storage range 
(e.g. 107°°8 to 10°98) and a correspondingly high number of bits (e.g. 64), the 
approximation is in many cases justifiable so we will forego discussion of it. 

The first tool we introduce for describing the sampling process is the impulse 
train, whose use we will demonstrate on a known problem: representing a contin- 
uous periodic signal with a Fourier series. 


Both the techniques and the results obtained can be elegantly carried over to 
deal with sampling. The line spectrum of a periodic signal is closely related to 
the sample values of a continuous signal by the duality principle of the Fourier 
transform. 
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11.2. Delta Impulse Train and Periodic Functions 


11.2.1 Delta Impulse Train and its Fourier Transform 


We understand delta impulse traan as the sum of an infinite number of shifted delta 
impulses, as shown in Figure 11.1. Like the delta impulse itself. it is a generalised 
function, in the sense of distribution theory. We will be using the symbol 111 (¢), 
which has the same form as the impulse train, as a short form. Because of its 
similarity with one of the letters in the cyrillic alphabet, it is also called the ‘sha- 
symbol’, Using this symbol, the impulse train is given by the formula 


a(t) = 1L(¢t)= S> 6(t—p). (11.1) 
2 12 tf 


Figure 11.1: Delta impulse train 


The Fourier transform of the delta impulse train can be obtained simply by 
transforming the individual impulses with the displacement theorem, 


Ne ee 


to 


Rae Bees (11.2) 
p=—os 
As each individual exponential term e~)"“ has period 27, X(gw) = X(j(w + 27)). 
The form of the spectrum X (jw) from (11.2) is correct but impractical, because of 
the infinite sum. In order to derive a more helpful expression, we multiply X (yw) 
with a si-function in the frequency-domain, and obtain 


Y (jw) = X (jw) x «() . (11.3) 


The function si(w/2) has zeros at w = 42m, +47, ..., for which the distance 27 
corresponds exactly to the period of X(jw). Although the product X (yw) xsi(w/2) 
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looks complicated. Y (yw) is a very simple function, and we will explain this by 
taking a detour through the time-domain. Inverse Fourier transformation with 


Ww 


si ($) o--@ rect(t) 


and convolution yields 


a(t) = LiL (t)*rect(t}) = 1. (11.4) 
LU rect(t) , 
ao oh” 102 i) 2 t -4 4 i 1 


Pigure 11.2: Convolution of a delta impulse train with a rectangle function 


The time function initially looks more complicated than its spectrum. As 
rect(¢) has width 1 which corresponds exactly to the interval between the impulses 
in LLL(t), however, the convolution LLL(t) « rect(t) simply yields the constant 1 
(see Figure 11.2). Y (jw) is therefore equal to a delta impulse with weight 27. 


y(t) =1 o—e Y(jw) = 275(w) (11.5) 


We could now determine X(jw) from (11.3), but since si(w/2) is zero at the points 
w= 27. td. ..., and the value of the product is likewise zero ~ we do not know 
what the value of X (gw) would be. For these points, however, the periodic nature 
of X(jw = X(j(w + 27)) determined with (11.2) comes into use. By comparing 
(11.3) and (11.5) it can be confirmed that 


X(jw) =2nd(w) for -r7<w<n. (11.6) 
For (11.2), periodic continuation. yields 
X(jw) = 3 e Ihe ys 2nd{w — Qrp) = uz) : (11.7) 


p= 00 flO 


Here we have used the scaling property (8.19) of the delta impulse 


275 (w — Qrp) = 6 (= a 1) (11.8) 
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The astonishingly simple result of this can also be expressed as follows: the 
Fourser transform of a delta ampulse train in the teme domain is a delta wmpulse 
train wn the frequency-domain: 


(11.9) 


In order to keep the derivation as simple as possible, we defined an impulse train 
with an interval of 1 (11.1). To describe sampling procedures with an arbitrary 
sampling interval T we use the delta impulse train 


a= se é(t — nF) = ali (=) (11.10) 
[EE OO 


We also describe these with the sha-symbol from (11.1), where the scaling property 
(8.19) is important 


5(t — pT) = zs (= * u) (11.11) 


With the similarity theorem, we can derive from (11.9) the general relation 


(11.12) 


11.2.2 Fourier Transformed Periodic Signals 


The connection (11.12) between delta impulse trains in the time-domain and 
frequency-domain is very elegant and can greatly shorten otherwise complicated 
calculations. Its use, however, requires some practice, so before we employ it 
to deal with sampling continuous functions we will try it out on some classical 
problems, in particular, representing periodic signals in the time- and frequency- 
domain. Periodic signals have a line spectrum where the distance between the 
lines is given by the periods in the time-domain. The weighting of individual lines 
can be determined using Fourier series. We will now use the delta impulse train 
to derive these. 

First we consider a periodic time signal «(t) with period T. It can be rep- 
resented as convolution of a function xo(t) with a delta impulse train (see Fig- 
ure 11.3), 


6) SAS ace id (=) (11.13) 


The separation 7 of the impulses is sct so that there are no gaps between repeti- 
tions of the function xo(t). 
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Xo(t) 
x(t) a 
aie 
oe one = * 
i t 
BT. at 7 or ¢ f Ul GA) 


Figure 11.3: Representation of a periodic signal x(t) as the convolution of a period xo(t) 
with a delta impulse train 


For the Fourier transform X(jw) of the periodic signal x(t), we obtain with 
(11.12) and the convolution theorem 


iar 


X(ju) = XoGiw)a (S2) = 7278 (w- Zu) Xoliv) (11) 


The Fourier transform X (jw) is therefore -- as we already know — a line spectrum 
with a distance of w = 3 between the lines. The weights correspond to the 
respective values of the spectrum Xo(jw), multiplied with 27. 

Figure 11.4 shows this relationship between the impulse train and the con- 
tinuous spectrum Xg(jw) of one period. The height of the arrow symbolises the 
weight of the impulse. The relationship between the periodic time signal and the 


Figure 11.4: The Fourier transform of a periodic function is a line spectrum 


individual lines in the spectrum is obtained as the inverse Fourier transform of 
(11.14). Using the selective property, the integral of the inverse Fourier transform 
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becomes a surn of the individual frequency lines: 


$) : alia WP) eltdis (11.15) 

a(t) = ae ale ol9 ran KL .de 
oO 

bya Y (AE ere (11.16) 


Equating this expression with the general form of the Fourier series or a periodic 
function gives 


ath) = S Aye t (11.17) 
With (11.16), we obtain ’ 
1 QTY 
Ay = —Xol| 7-— IL. 
7 o( P ( 8) 


for the complex Fourier coefficients A,. The spectrum X (jw) of the periodic signal 
x(t) is therefore a line spectrum where the weight of the individual lines is given 
by the Fourier coefficients of x(t). The Fourier coefficients are also the values of 
the spectrum NXo(jw) with period xo(t) at multiples w = vat of the fundamental 
frequency a (see Figure 11.4). . 

This compact derivation shows that using the impulse train and the sha-symbol 
saves cumbersome calculation. We will refer back to it when we deal with sampling. 
The emphasis will then lie on sampling functions of time, instead of finding sample 
values from a spectrum. Firstly, however, we will deal with convolution of periodic 
and aperiodic signals. 


11.2.3 Convolution of a Periodic and an Aperiodic Signal 


The output signal of an LTI-system can be obtained in the time-domain using 
convolution of the input signal with the impulse response (see Section 8.4.2). If the 
input signal is periodic, the output signal will also be periodic. We are interested 
in the relationship between the Fourier coefficients of the input and output signals. 
‘The corresponding convolution integral thus deseribes the convolution of a periodic 
signal (the input sigual) with an aperiodic signal (the impulse response). 


Example i1.1 


As an example we consider a periodic input signal z(t) with the Fourier series 


a(t) = 57 Agei™** (11.19) 
k 
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and an LT I-system with impulse response 


h(t) = e~*e(t) (11.20) 


as shown in Figure 11.5. Comparing (11.19) and (11.17), we recognise that the 


3 


period is T= 1. 


ra Oa a >. A,el®?tt h(t)=e'e(2) 
k 
Figure 11.5: Convolution of a periodic input signal with an aperiodic impulse response 


The frequency response of a system is obtained from the system function for 
8 = Jw: 


H(jw) = (11.21) 
The Fourier transform of the input signal is a linc spectrum: 


X (jw) = S° 2m Ap, 6(w — 27k). (11.22) 
k 


The output signal likewise has a line spectrum, as for the product Y(jw) = 
H(jw)X (jw), we obtain 


. 9a . 27 Ap . 
Y ,) = St" xX 4 — ee si! 
(jw) = H(jw) X(jw) » (; me) 6(w — 2k) 
- 
4 (11.23) 
= Ag Gimkt 
WO) =D ( + ae) Z 


k 


The final inverse transform gives the Fourier series of the output signal. Its Fourier 
coefficients are the product of the Fourier coefficients of the input signal and the 
values of the system frequency response at the frequencies of the individual spectal 
lines. 


Convolution of any periodic signal with period T that can be represented by 
its Fourier coefficients A; (11.17), with an aperiodic signal h(t) yields 


aa » amkd 7 2 k 
y(t) = SS Cpe with Ch =H () Ay ; (11.24) 


kz 00 
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where H(jw) = F{h(t)}. If h(t) is the impulse response of an LT'L-system, H(jw) 
is its frequency response, and (11.24) specifies how the Fourier coefficients are 
changed by the system. 


11.2.4 Periodic Convolution 


It seems likely that the results of the last section can be extended to convolution of 
two periodic signals with the same period, but in fact, the product of both periodic 
signals under the convolution integral is likewise periodic. The convolution integral 
of two periodic signals therefore does not converge. Since, however, all of the 
information about a periodic function is embedded in a single period, it must be 
possible to define a modified convolution by only integrating over one period. 


Definition 18: Periodic convolution 


The periodic convolution of two perrodic signals «,(t) and xo(t) with the same 
period T ws given by 


TotT 
y(t) = | ni(z) tat — 2)de= 24 ()@x0(t). (11.25) 


To 


ft 48 also called cyclic convolution. 


The exact location of the integration limits, determined by ro is unimportant as 
long as the integration is only performed over one period of length T. Periodic 
convolution corresponds to normal convolution of a periodic signal x, (¢t) with a 
period of x9(t), or a period of x, (t) with the periodic signal x(t). 

The result y(t) of periodic convohation is likewise periodic. We are again inter- 
ested in the relationship between the coefficients of the Fourier series representation 


a(t) = >) Axel at/? (11.26) 
k 

Boley so Se Byer anys (41.27) 
£ 

Wy = > Cer (11.28) 
k 


First of all we put (11.26) and (11.27) into (11.25) and re-order the terms 


TotT 
y(t) = S$) > AnBe ; gltmth-OCIT ges eJantt/T (11.29) 
k é 
To 


The terms ¢/27(*—92/T in the integral have magnitude 1 for k ¢ €, and a phase 
rotating with period T’/(k — €), and for k = @ they are constant with the value 1. 
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Therefore for the integral, 


TotT 


sf T =k 
jantk—&) T/T = 11. 
€ dt= { 0 ek (11.30) 


Ta 


In other words: the basis functions of the Fourier series are orthogonal. Putting 
this into (11.29) yields 
y(t) = S> Ag BeTe??7ht/T (11.31) 
k 
By comparing (11.28) and (11.31), we find the connection between the Fourier 
coefficients of y(t), 21(¢) and xo(t) 


Cy = ApByT (11.32) 


11.3 Sampling 
11.3.1 Ideal Sampling 


Now that we are comfortable with the spectra of periodic signals and the delta 
impulse train, we can use it to describe the sampling of continuous signals. We will 
first. deal with ideal sampling, where we take the precise values of the continuous 
function at. sample points. This idealisation allows us to identify the fundamental 
principles particularly simply. Later we will see that the concessions necessary 
for realisation can also be described by simple extensions of the concept of ideal 
sampling. 

To model ideal sampling we start with a continuous signal £(£) and multiply it 
with an impulse train #111(4), as shown in Figure 11.6. The result x(t) is again 
a series of impulses. The weight of the individual impulses are the values of the 
signal at points t= kT,k © Z..In Figure 11.6, the weights are symbolised by the 
lengths of the arrows. For the spectrum X (jw) of the sampled signal a(t) we use 
the multiplication theorem (9.75) to obtain 


x(t) = &(t)- pl @ oe X(qw) = 5 (ow) * LL (#) d (11.33) 


Convolution of the spectrum X (jw) of the continuous signal with the inpulse train 
in the frequency-domain LLL (wT'/27) gives a periodic continuation of X(jw) at 
multiples of 27/T, as shown in Fig 11.7. 

The frequency wy = om is called the sampling frequency. ‘The spectrum of the 
sampled signal in the frequency-domain is clearly periodic with period wy, and 
there is a duality here with the Fourier transform of periodic signals, illustrated 
by the following scheme. 
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periodic signal o-—e line spectrum 


sampled signal o-—-e periodic spectrum 


Figure 11.6: Ideal sampling of the signal £(¢) 
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Figure 11.7: Spectrum of the sampled function &(t) 


11.3.2 Sampling Theorem 


Analog signals are sampled so that they can be recorded or processed using digital 
technology. It is also usually desirable with most applications to reconstruct the 
analog signal from its sample values, for example, with Compact Discs, ‘The music 
signals are sampled because there are many technical advantages of storing a 
digital signal as opposed to an analog signal, but the user of the CD-player is only 
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interested in the analog music signal, and not the sample values. It is therefore 
worth knowing whether a continuous signal #(t) actually can be reconstructed 
from the sampled signal x(t). This is exactly what the sampling theorem deals 
with, which we will be covering in this section. 

To begin we introduce the concept of a band-limited signal. 


Definition 19: Band-limited signal 


A signal &(t) is band-limited of its spectrum X(jw) ws zero 


=.» J any value |w|] <wy 
X (jw) 7 { 0 |u| 2 We, 


above a frequency wg. The frequency wy is called the band limit. 


Figure 11.8 shows the spectrum of a band-limited signal, which in this case ar- 
bitrarily has a triangular form for |w| < wy. To distinguish between the periodic 
repetitions by sampling, this is also called the baseband spectrum. 


Figure 11.8: Baseband spectrum with limit frequeny w, 


We can use it to formulate the central principle of the sampling theorem. 


If a band-limited signal z(t) is sampled frequently enough, so 
that the baseband repetitions do not overlap, i(t) can be inter- 
polated from the sampled signal x(t) without error. 


The justification for the sampling theorem will be explained by considering it in 
the frequency-domain. Figure 11.9 shows the spectrum of a sampled signal with 
the repeated baseband from Figure 11.8 at multiples of the sampling frequency 
ily 2 3B Reconstruction of the original signal requires an interpolation filter 
H(jw), that leaves the baseband unchanged. but suppresses all of the repetitions 
caused by sampling. Such a filter can always be found if the sampling frequency 
We = a is greater than or equal to double the bandlimit wy of the band-limited 
signal %(t). 


¢ 


T t 
Wa = a 2 wg or TS —. 
; 9 
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interpolation 
filter 1 


H(jo) A 


Figure 11.9: For wg < %, the signal (gw) can be reconstructed using the interpolation 
filter: (ju) 


X(ja) 


“We Wp 


4B 


If this condition is violated, then the repeated baseband overlaps itself, and 
can no longer be separated by convolution (see Figure 11.10). The overlapping 
that occurs in the dashed region is also called aliasong as an obviously erroneous 
reconstruction by the interpolation filter leads to high-frequency signal compo- 
nents appearing at other locations in the incorrectly reconstructed baseband. The 


Figure 11.10: Overlapping baseband for wy > # 


sampling frequency wy = a 

= 1 _ Wa 

f= Om 

is also called the sampling rate. It specifies how often the signal will be sampled 

per unit time. Sometimes f, is called the sample frequency. To clearly distinguish 

between f, and w,, the terms ‘sampling rate’ and ‘angular sampling frequency’ 
should be used. 


(11.34) 


Different choices of the sampling rate cause different cases to occur, shown 
in Table 11.1. Clearly, critical sampling represents the border case where the 
sampling rate is as low as possible, but aliasing has still been avoided. In this case 
the ideal interpolation filter is a rectangle in the frequency-domain with frequency 
response H(jw) and impulse response h(t) (see Figure 11.11): 


H(jw) = root ($7 e—oh(t) = «(#) | (11.35) 
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Table 11.1: Describing different sample rates 


: ud : 
to > 7 oversampling 
wl Le, ‘ 
fa=— critical sampling 
3 ener 
Nyquist-frequency 
: tw . 
ta< — undersampling 
1 hase 
=> aliasing 
overlapping spectra 
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Figure 11.11: Impulse response of an ideal interpolation filter 


In the frequency-domain it is clear that the spectrum X(jw) of the original sig- 
nal %(t) can be recovered by multiplication of X (jw) with H(jw) (11.35). Scaling 
by 7’ is necessary because the individual impulses of the impulse train ge Lil a) 
in (11.33) have a weight of +. 
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Figure 11.12: Sampling and interpolation with an ideal interpolation filter 


In the time-domain we can obtain with some rearrangment, the reconstructed 
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signal q(t) (Figure 11.12) 


gt) = je Fas ( 4) en(F (11.36) 


= | x 2(KT)S(t — in (3) (11.37) 


kom — oc 


= t—kT 
ze S° &(kT) (5). (11.38) 


k= 00 


Perfect reconstruction 9(t) = &(t) from the sample values succeeds through inter- 
polation if the sample values are used as scaling factors of appropriately shifted 
si-functions (see Figure 11.13). Of course, it must be possible to represent &(t) 
by shifted and scaled si-functions. From (11.33), with (11.35) — (11.38) we can 
see that this requirement is equivalent to band-limiting with wy < #. For values 
| = kT all si-functions but one are zero. This one si-ftnction has its maximum 
value of 1 at this point. The sample values (kT) are therefore the weights of 
the sifunctions, and between the sample values, all (infinitely many) of the si- 
functions are superimposed, such that the nearest sample values have a greater 
influence on the signal value than those far away. 


4 HO = 36) = Dae) o =) 


Figure 11.13: A band-limited signal @(t) can be put together from a series of shifted 
weighted si-functions 


The basic idea of the sampling theorem comes from Lagrange (1736-1813), 
and interpolation with the si-function was described by Whittaker in 1915. The 
sampling theorem in its current form, however, was introduced by Shannon in 
1948. 
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11.3.3 Sampling Theorem for Complex Band-Pass Signals 


If we consider periodic continuation of the spectrum by sampling, for example, 
Figure 11.9, we see that the baseband spectrum between —w, and w,, and the 
periodic continuation stand next to each other at multiples of the sample frequency. 
The spectrum of the original signal @(t) could lie just as well between —w,+ = and 
+wWg + on or even between 0 and = - the periodic continued spectrum X (jw) 
would be fundamentally indistinguishable. Correct choice of the interpolation 
filter for reconstruction of £(t) requires knowledge of which region of the frequency 
axis the signal occupied before sampling. This leads to the sampling theorem for 
complex band-pass signals. - 

We start with a signal Z(t), with spectrum X(jw) (Figure 11.14). As it has no 
frequency components lower than (|w| < wo) or higher than (|w] > wo + Aw), it is 
known as a band-pass spectrum. The corresponding time signal must be complex 
as the conditions for conjugate symmetry (9.49) are not fulfilled: 


X (jw) 4 X*(—jw) = — &(t) complex. (11.39) 
Yomplex band-pass signals are of special importance in communications; they 


are represented by two real signals: one for the real part, and one for the imaginary 
part. 


Mo MotAw 


Figure 11.14: Unilateral band-pass spectrum 


If we sample this signal with sampling rate 


it ia 
ta = 7 = OR where. Wy = Aw 


we again obtain a periodic continuation of the spectrum where overlapping is 
only just avoided; a case of critical sampling. Figure 11.15 shows the spectrum 
of the sampled signal and the impulse train, that corresponds to the sampling 
frequency wy, = Aw. There is no condition for the relationship between wo and Aw. 
Both frequencies can be chosen independently. Critical sampling is clearly always 
possible for complex band-pass signals. We will soon sec that for an apparently 
simple case of a real band-pass signal that it is not. 

To recover the original signal, the interpolation filter should be chosen so that 
it blocks all frequency components not in the spectrum X (jw) of the original signal 
z(t). Its frequency response is a rectangle in the band-pass location: 
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Figure 11.15: Spectrum of the sampled complex signal 


niey~tma((ow8)2). a 


There is no conjugate symumetry here either, so the corresponding impulse response 
is complex: 


\. ' 
A(t) = si (# eHwot Mt (11.41) 
Figure 11.16 shows the real and imaginary parts of h(t) for wo = 4Aw. 


11.3.4 Sampling Theorem for Real Band-Pass Signals 


For the apparently simple case of a real band-pass signal, correct choice of sample 
frequency is not as simple as for the complex band-pass signal. The spectrum 
of a real band-pass signal is shown in Figure 11.17. The conditions of conjugate 
symmetry are fulfilled in this case. 

Critical sampling requires a sample rate of 

to is = mon Le., wg = 2Aw. 
T T 

In contrast to complex band-pass signals, in this case, critical sampling is only 
possible if w and Aw have a particular relationship with each other. Continuation 
of the band-pass spectrum without gaps requires that the space between —w and 
wo in Figure 11.17 can take exactly an even number of half-bands of width Aw. 
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Figure 11.16: Complex impulse response of the interpolation filter 
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Figure 11.17: Band-pass spectrum of a real signal 


The even number condition comes about because of the conjugate symmetry with 
w = 0, and therefore 
wa =n-Aw,nelN. (11.42) 


Otherwise the space in Figure 11.17 cannot be completely filled with half-bands 
and critical sampling is impossible. Figure 11.18 shows the spectrum of the criti- 
cally sampled signal and the corresponding delta impulse train for n = 2. 

The ideal interpolation filter must take exactly the frequency components that 
were contained in the original band-pass signal. We can describe it with a rectan- 
gular frequency response in the baseband, that is shifted by convolution with two 
symmetrical delta impulses to the band-pass locations: 


H (jw) ~ ree( 2) ‘ t (o-o»- +4(otone | _ (11.43) 


The corresponding. impulse response is purcly real and resembles the impulse 
response of the interpolation filter (11.35), but because of the band-pass character, 
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Figure 11.18: Spectrum of the sampled real signal 


it is multiplied by another cosine function: 


A(t) = “(3 cos (( + *)s) (11.44) 


Figure 11.19 depicts the impulse response for wo = 3:Aw, (n = 3). It can clearly 
be seen that the envelopes in Figure 11.19 agree with the curve in Figure 11.11 
when the time axis is scaled by a factor of 2. (11.44) is also valid for the case 
wy = 0, in the low-pass case (11.35) (Exercise 11.22). 


A(t) 
rath /\ | Mt My, ALAA 
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Figure 11.19: Impulse response of an interpolation filter for a critically sampled real 
band-pass signal with wo = 3Aw 


The sampling frequencies determined for the three cases of critical sampling are 


11.3. Sampling 279 


shown in Table 11.2: Comparison with Figures 11.8, 11.14 and 11.17 reveals the 


Table 11.2: Sampling frequencies for critical sampling 


baseband signal Wy = 2wg 
complex band-pass signal } wg = Aw 


real band-pass signal Wy = 2Aw 


following simple rule for choosing the sampling frequency: for critical sampling, 
the required sample frequency w, is equal to the complete width of the frequency 
bands in which X(jw) is non-zero. This also requires that the spectra are chosen 
so that critical sampling is possible. 


11.3.5 Non-ideal Sampling 


Until now we have not considered physical implementation of the sampling prace- 
dure. We have assumed that it is possbible to take the values £(kT’) of the signal 
&(t) at precisely defined points t = kT, as depicted in Figure 11.20. In fact, the 
sampling procedure requires that energy is taken from the signal #(t) for each sam- 
ple value. For example, an electrical signal can be sampled by taking some charge 
at each sample point and storing it in a capacitor. The resulting capacitor voltage 
is a measurement of the sample value. Charging a capacitor requires, however, 
a certain timespan, so the capacitor voltage cannot be assigned a definite signal 
value of &(¢) at a clearly defined point in time (see Figure 11.20 below). 

We can also describe such non-ideal sampling with an impulse train, if we 
formulate the collected charge over a time ¢ as integration: 


t+ 7/2 

1 1 t 

_ r(v)dyv = z(t) * — —|. lie 

= / Z(v)dv = x(t) * ~rect (<) (11.45) 
t—T/2 


The integration time z must be smaller than the sampling interval (¢« < T). The 
series of rectangles that describe the sampling procedure is shown in the middle 
of Figure 11.20. They are each centralised at the desired time point, although 
strictly speaking, the integrated value is only available at the end of the integration 
interval. In this manner we avoid having a delay term in the calculation. The 
sampled signal x(t) is thus 


aCe x P “rect (£)| tu(4) . (11.46) 
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x(t) 


Figure 11.20: Sampling a signal in the real-world 


A diagrammatic description of this sampling procedure is shown in Fig- 


ure 11.21. Compared to the ideal sampling in Figure 11.6, there is an additional 


system with impulse response h(t) = zrect (=) 


1 
a 


Figure 11.21: Non-ideal sampling of the signals Z(t) 


1 1 
ee lle) 


x(t) 


The description of non-ideal sampling introduced here with the example of an 
electrical signal also applies to other signals. In every case, measurement of a 
signal value requires a certain time. A further generalisation is the assumption 
that the energy transfer is not uniform within the time z. We can take this into 
account using any weighting function a(t) with 


e a 
a(t) > O for— 5% ae a (11.47) 
a(t) = 0 otherwise. 


instead of the rectangle function. Before the integration, @(v) in (11.45) is multi- 
plied by a(t—v). In connection with optics, a(t) is also called an aperture function. 
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For the sampled signal, 


a(t) = at * a(t)| : put] : (11.48) 


We found the fundamental property with ideal sampling, that the spectrum 
of the sampled signal consists of the continuation of the spectrum of the non- 
sampled signal. We will now investigate what influence non-ideal sampling has on 
the frequency-domain. To simplify this, we will be limited to rectangular apertures 
in accordance with (11.46). The Fourier transform of (11.46) yields the spectrum 
of the sampled signal X (jw) 


X (ju) = = Lu “($) * mes (11.49) 


Compared with the spectrum of the idcal sampled signal (11.33), it is striking that 
the spectrum of the original signal X(jw) is weighted with the aperture betore 
periodie continuation. Figure 11.22 shows a possible spectrum of the original 
signal X(jw) (as in Figure 11.8) and the weighting with the Fourier transform 
of the rectangle impulse. As with the rectangle, the greatest value with c= T 
has been taken, which corresponds to an integration with duration z over the 
enitire sampling interval 7. The first zero of the si-finction then lies exactly at the 
sampling frequency w = 20/T. 


X(jo) 


Figure 11.22: Spectrum of the sampled signal 
In order to estimate the effect of sampling on the frequency response, we cal- 


culate the value of the si-function at the highest frequency that X(jw) can contain 
without causing aliasing errors: 


| 2 
o( $) 2 a = —3.9dBforc<T. (11.50) 
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The highest frequency component is damped by nearly 4 dB; for all lower fre- 
quencies the damping is lower. An integration time c, that is shorter than the 
sampling interval likewise reduces the damping effect. In many applications this 
effect can be tolerated and where appropriate can be balanced out by a suitable 
post-connected aperture correction filter. For example, most 'T’'V cameras have 
an aperture correction filter that compensates for the filtering effect of the row 
sampling of the image. In fact, components at frequencies above half the sam- 
ple frequency are strongly damped by interpolation, but they are not suppressed 
enough that the resultant aliasing is tolerable. If such frequency components oc- 
cur they still should be suppressed by a special anti-aliasing pre-filter, that blocks 
frequencies above half the sample frequency. 


11.3.6 Reconstruction 


It is not only necessary to consider side-effects from the implementation when sam- 
pling, but also during reconstruction of the continuous signals from their sample 
values. Although the description of reconstruction using an impulse train (11.36 to 
11.38) is theoretically very elegant, impulse trains and approximations using short. 
high voltage peaks are not practical for use in electrical circuits. Real digital-analog 
converters therefore do not use these signals, and use instead sample-and-hold cir- 
cuits and staircase functions whose step height is the weight of the corresponding 
delta impulse and so corresponds to the actual sample value. 

We still keep the advantages of the delta impulse train, however. The staircase 
functions can be thought of as a delta impulse train interpolated with a rectangle 
of width T 


a(t). = a(t) * = rect ( - :] : (11.51) 


Figure 11.23 shows an impulse train and the corresponding rectangle function. 
The rectangle impulse does not lie symmetrical to the sample points, instead 


x(t) 


TO 2T t 


Figure 11.23: Signal interpolated with a sample-and-hold circuit 


shifted from the symmetrical position by T'/2, so because of the shift theorem, a 
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corresponding exponential term appears in the spectrum. 


wt. 


X' (jw) = X(jw) + si (+7) a a (11.52) 


Figure 11.24 shows the magnitude of the resulting spectrum X’(jw). While 
in Figure 11.22 the baseband spectrum was weighted with a si-function and then 
periodically continued, here the periodic spectrum X (jw) is already provided and 
is then weighted by multiplying it with the si-function. This damps the reoccur- 
rences of the baseband (shaded in Figure 11.24), but unfortunately does not fully 
suppress them. The shaded area could, for example, be audible high-frequency 
noise in an audio signal, or appear in an image as visibly ‘blocky’ pixels. However, 
unlike aliasing errors which cannot be separated from the desired signal, these 
noise components can be fully eliminated by post-connecting a low-pass filter with 
impulse response A(t) (11.35). The residual reduction in high-frequency compo- 
nents in the baseband can likewise by compensated for using a filter which can be 
implemented either digitally before the DAC or after as an analog filter. 


4 X(ja) & ( oT) 
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Figure 11.24: Magnitude response |X'(jw)| of the signal interpolated with sample-and- 
hold circuit 


Example 11.2 


The problems described with reconstruction also occur in film projections. 
Recording and replaying a series of individual images can be considered as sampling 
of a scene continuously changing in the time-domain. Per second, 24 individual 
images are taken, so the sampling frequency is 


Te = 2 =: 24H. 


284 11. Sampling and Periodic Signals 


Interpolation when the film is played back is very easy to implement when each 
image is projected for the corresponding length of time, although in fact, they are 
not there for the entire interval T = 1/24s, as between two images, the film has to 
be moved. There is no practical interpolation filter available for this optical signal, 
as in Figure 11.9, so the re-occurrences of the spectrum at 24 Hz, 48 Hz, 72 Hz,... 
are not removed and are perceived by the eyes as flicker. The eyes are sensitive to 
flicker wp to around 60 Hz, but the first re-occurrence at 24Hz creates more visual 
disturbance. To avoid this problem, a trick can be used: instead of interrupting 
the projection of an image once for the film transport, it is interrupted twice (see 
Figure 11.25). The interrupting is done with a mechanical blind which is easily 
to implement. It doubles the sample rate (to 48 Hz), and pairs of consequential 
sample values are equal because they come from the same original. 


nb 
1 a 


movement of film 


to 


t 


| 


To 


Figure 11.25: Impulse response of the interpolation filter 


The effectiveness of the double projection procedure can be explained theoret- 
ically. We represent the double projection of an image as the impulse response of 
an interpolation filter (see Figure 11.25) and find the spectrum: 


h(t) = vet( 7] K | (:-2 0-5-8) (11.53) 
= rect @ (3-7) * [ Ga +a(4-%) Jorn 


Ti ver ca 
A(jw) = To “(3 ) eIF+T) . 208 (-7) (11.55) 


Ti T Pace opp 
|H(gw)| = anos( 2) COS (7) (11.56) 
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Figure 11.26 shows the periodic spectrum corresponding to 24 images per sec- 
ond and the weighting by the interpolation function A(t). An image signal has a 
dominant frequency component at w = 0. The zero of the spectrum at the sam- 
pling frequency 24 Hz extensively suppresses the first reoccurrence. The second 
at 48 Hz is not weakened significantly, but the flickering becomes much less no- 
ticeable. Additionally, the flicker reduction only functions when both rectangles 
that form h(t) (Figure 11.25) are shifted away from each other by exactly T/2. 
Reduction of the components at both 24 Hz and 48 Hz can then be achieved using 
triple projection (Exercise 11.24). 


YT; zero at 24 Hz suppresses 
Xo) annoying flicker 


24Hz 48Hz 


ies 


Figure 11.26: Magnitude response of the interpolation filter with a zero at 24 Hz 


11.3.7 Sampling in the Frequency-Domain 


The sampling theorem states that band-limited signals can be reconstructed from 
their sample values if the sampling frequency is high enough that no overlapping 
occurs in the frequency-domain. Because of the duality between the time-domain 
and frequency-domain, a dual of the sampling theorem can be formulated: 


Signals of finite duration can be unambiguously reconstructed 
from a sufficient number of samples from their spectrum. Sig- 
nals repeated in the time-domain may not overlap. 


We can express this mathematically with the transform pair 


~ T wT 
Y Go)4 = 5 
(Jw) «5 ( ) (11.57) 


il 


Y Gw) 


il 


y(t) = y(t) * ui 4). (11.58) 
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Sampling in the frequency-domain is again idealized in (11.57) as multiplication 
with a delta impulse train. This corresponds to convolution (11.58), that causes 
periodic continuation of #(t) in the time-domain. If the signal g(t) is limited 
in time and its duration is less than T, sampling in the frequency-domain does 
not lead to overlapping in the time-domain. Then g(t) can be recovered from 
y(t) by multiplication with a time window of length T. In the frequency-domain, 
this corresponds to an interpolation (convolution) with the spectrum si(wT/2), 
that transforms the line spectrum into the smooth spectrum belonging to g(t). If 
overlapping occurs in the time-domain, an error-free reconstruction is impossible. 
In this context we use the term tame-domatn aliasing. 

Sampling in the frequency-domain is always carried out if values of a spectrum 
are to be stored in the memory of a computer, where continuous functions cannot 
exist, only a series of numbers. The necessary restriction to time-limited functions 
is, for example, achieved by splitting the signal into sections with finite duration. 
The relationship between a series of finite length and their spectra is represented 
by the discrete Fourier transform (DFT). 


11.4 Exercises 


Exercise 11.1 


Write the sketched signal with a sum of delta impulses as well as with the LLL 
symbol. 


x(t) 


—5 


Exercise 11.2 

Determine the Fourier transform X(jw) of z(t) = LiL(at) and sketch x(t) and 
X (jw) fora = $,a= 1 and a = 3. Note: use transform pair (11.12) 

Exercise 11.3 


Consider a delta impulse train shifted by to: 


x(t) 


“ttl t tt 


O fy 14t, 2+l f 
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a) Give a(t) and X(jw) with LLL symbols. 


b) What symmetry does x(t) have for ty = 0, to = ; and ty = 4? Use your 
answers to derive the symmetry of X(jw). Note: see symmetries (9.61). 


¢) Sketch X (jw) for to = i and ty = 4. Write X (jw) as a sum of delta impulses. 


Exercise 11.4 


Give X,(jw) and X2(jw) as well as x1(t) oe X (jw) and x(t) o--- Xo(jw) using 
the LLL- symbol and sketch both functions of time. 


XG) XG) 
t, ; (4) 
1 
een . oes eo0 (1) ee6 
[ a ee L teas Le, eli les 
i 0 ni w -3 012 3 6 9 @ 


Note: represent X,(jw) as a sum of two spectra. For the sketch, represent the 
result as a sum of delta-impulses. 


Exercise 11.5 
Calculate the Fourier series of the following periodic functions using a suitable 
analysis. 
Note: evaluating the coefficient formula is not necessary. 
a) 2q(t) = cos(3wot) x sin? (Qwot) 
b) xy(t) = cos? (Quot) x sin(wot) 
c) a(t) = sin*(3wot) x cos* (wot) 
Exercise 11.6 


Consider the functions 


y(t) = cos(6wot) + cos(9wot) 
ao(t) = sin(wot) x cos(W2wot) 
r3(t) = ao(t) +cos(wot) x sin(V2wot) 
5 
Talt) = be sin(/Ywot) 
v=l 


T 
g5(t) = sin (F¢) + cos ($4) 
a) Test which are periodic, and give the periods where possible. 


b) Give the Fourier transforms Xy(jw) ... and X5(jw). 
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Exercise 11.7 


Expand the following periodic signals using the coefficient formula in a complex 
Fourier series a(t) = )7 A,,e!’°". Give the fundamental angular frequency wy for 
be 


each. 


a) alts sin” w)t 


p) Xp (0) 
®ee 1 @ eo 
0 ee T 2T t 
4 
c) x(t) 
ae @ 1 e@e6 
a 2 “t 
T 
2 é 1 aisasit 2n 
Note: coefficient formula A, = = | x(t)e’' dt, T= — 
T Wy 
0 


Exercise 11.8 
; a Z ; 
Show that X(jw) = Sv e7I4# = LiL (5-). see (11.7), by expanding the right- 
2) 
hand term into a Fourier series. 


Exercise 11.9 
Consider &(t) = si?(rt) and the periodic signal a(t) = Z(t) * 111 (4). 


a) Calculate and sketch X(jw) and then X(jw). How do the weights of the 
delta impulses of X (jw) tie in with X(jw)? 


b) Give the Fourier series expansion of x(t) with (11.18) and sketch the series 
of the Fourier coefficients A,,. 


Exercise 11.10 


Give the Fourier transform of z(t) = rect (4) and the periodic continuation x,(t) = 
a(t) * LiL (4). Calculate X,(jw) 


a) using convolution in the time-domain. 


b) using the convolution theorem. 
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Exercise 11.11 


(11.22) allows the spectrum of a signal a(t) with period T = 1 to be expressed by 
its Fourier coefficients A,. Derive the relationship for general periods T. ‘There 
are two possible routes to the solution: a) starting with (11.14) and (11.18), and 
b) using the Fourier transform on (11.17). 


Exercise 11.12 

Find the Fourier transform of the signal from Exercise 11.7, using the results from 
Exercise 11.7 and 11.11. 

Exercise 11.13 


A system with impulse response h(t) = sin(t)e~®!*te(t) is excited by a periodic 
rectangle signal z(t). Find the output signal y(t) as a Fourier series. See Sec- 
tion 11.2.3. 


x(t) 


Exercise 11.14 


Calculate the cyclic convolution of the signals f(t) and g(t) = sin(wot) using 
Fourier series. First give the connection between wy and 7’, so that the cyclic 


convolution is defined properly. 


fit) 


t 

Exercise 11.15 
Consider the spectrum X (jw) of the signal x(t). 

| XGion) 

[\ 
| 
-Wg Wy wo 
Find X,(jw) e--o x(t) x FILL (4) and sketch it for T, = ap) 2 = an 
6 a g Wy 
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and 74 = on For which cases does aliasing occur? What cases are critically 


sampled? 


Exercise 11.16 
. We .» [Wgb\, ar PORES: 
A signal z(¢) = eg (2) is sampled at equidistant points in time vT,v € Z 
_to form a signal z,4(t) of weighted delta impulses. 
a) Give the original spectrum X (jw) = F{x(¢)} (sketch with labelled axes). 


b) Sketch the spectrum X4(jw) e—-o 2 4(é) for the case T' = — 
wg 


Exercise 11.17 


The sketched rectangular signal r(¢) will be investigated. 


r(t) 
| 
ia 
ft | t t 


a) What is the spectrum R(gw) = F{r(t)} of the signal for both magnitude 
and phase? Sketch |R(jw)]. 


b) The spectrum R(jw) is sampled at equidistant points spaced by wo. This 
creates the new spectrum: 
oO 
Ra (jw) = wo S R(jvwo) - d(w — vwy). 
Use OO 
Sketch the magnitude of this new spectrum for |w| < 4 with 
a) wo = 3, 
B ) Wo = ae, 
y) w= aR 
where the weighted delta impulses are represented by arrows of corresponding 
length. 
c) Sketch the functions of time r.(t), corresponding to the cases a), 3), y) in 


part. b). 
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Exercise 11.18 
The spectrum X (jw) is from a unilateral band-pass signal x(t). 
X(j@) 


=o a nee — 


(Wy —( g Mp Opty 


a) Is x(t) real-valued? What symmetry does a(t) have? 


b) The signal x(t) is created by critical sampling of x(t). Give the sampling 
frequency f, and the sample interval 7, for this case. Sketch X,(yw) for 
wo = 9m and for wy = 27. 


c) Sketch X,(jw) for sampling with f, = Sea wo and wy as above. 


Exercise 11.19 


The signal z(t) with the sketched spectrum X (jw) is modulated with the shown 
arrangement. 


X(jo) complex modulation 


el@ot , Oyo= 1 “10° 


: a ae 


a) Sketch the spectrum Y (jw) of the output signal. 


b) Draw an arrangement of sampler and reconstruction filter H(jw) that can 
demodulate y(t), so that x(t) is obtained at the output. What are the 
possible sampling frequencies? Sketch |H(jw)| for a suitable reconstruction 
filter. 

Exercise 11.20 
A signal with the sketched spectrum is sampled ideally with intervals T. 
| XG) 


-5 Wp 40, 40, 5a @ 
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a) Is the signal a high-pass, a low-pass, or a band-pass signal? [s it complex or 
real? 


b) Is critical sampling possible? 


c) Draw the spectrum X,(jw) of the sampled signal for T; = x, 1h = on and 
T; = 0.22. 


Exercise 11.21 


San the band-pass signals with the following spectra be critically sampled? For 
each signal, give the minimum sample frequency at which no aliasing occurs. 


(a) + X(jo) (b) X(jo) 
PNG So. de | IX 
—-#¥—}+-—+ oF a a es Se a 
-1.9 -09' 09 19 @ 45 3 | 3 45 


pe ae sp tt Ne 
Ee 2st ee O 6-293 13° 98 Mp 
a 
(e) X(jo) (f) + XG) 
n fie WA } 7 0 ee Se 
012 My 0315-25 a 


Exercise 11.22 


Show that the impulse response of the ideal interpolation filter for critically sam- 


Exercise 11.23 


A signal x(t), band-limited to fy = 20 kHz is critically sampled at frequency fu. 
The non-ideal properties of the sampling are represented by the aperture function 


Be 33 
l+-— for ~c<t<0 
Cc 


t 
1—-- for O<t<c 
zt 


0 otherwise . 


For parts a) and b), let z= - 


a 
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a) Draw A(jw) e—o a(t) and a suitable example for X (jw) in the same sketch. 


b) Compare the amplification of the aperture function at the frequency zero 
and at the band limits of the signal. By how many dB is it less at the band 
limits? 


c) Determine z so that the aperture function makes a suitable preliminary anti- 
aliasing filter if sampling is carried out at f, = 10 kHz. 
Exercise 11.24 


The effect of triple projection on the flickering of cinematic films (see Example 11.2) 
will be investigated. The interpolation filter takes the form of a mechanical shutter 
with the sketched impulse response h(t), 


h(t) iy 
1 
% movement of film 
T=6T, 
To To e 


Express A(t) using rect-functions and d-impulses, as described in (11.53). Then 
calculate H(jw) and sketch |H(jw)| for T = sum: In particular, try to identify 
the zeros of H(jw). 
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12 The Spectrum of Discrete 
Signals 


In Chapters 1 to 10 we got to know some powerful tools for dealing with continuous 
signals and systems. We carried out the conversion of real-world continuous signals 
to sampled signals in Chapter 11, which is necessary for digital processing. The 
sampled signals were treated as continuous-time variables so that the tools we had 
learnt, like the Fourier transform, could still be used. 

In a computer, we can only work with a sequence of numbers, that are defined 
over a discrete range by a numerical value (the index). Examples of such an index 
might be the sample number for a digital audio signal, or the pixel address within 
a digital image. In addition there are discrete signals that have not arisen from 
sampling a continuous signal. Examples of these are represented in Figures 1.3 
and 1.4. We need new tools to describe such sequences, and we will concentrate on 
them in Chapters 12 - 14. This chapter deals with discrete signals and the discrete 
form of the Fourier transform, the F, transferm. This transform is also referred 
to as discrete-tume Fourier transform (DTFT). The two following chapters deal 
with discrete systems and we will learn the discrete counterpart to the Laplace 
transform, the z-transform. 

In Sections 12.1 and 12.2 we will consider discrete signals together with some 
examples. The discrete-time Fourier transform will also be introduced, which we 
will use to examine discrete signals in the frequency-domain. We will see that it 
has similar properties to the Fourier transform for continuous signals. At the end 
of this chapter we will investigate the relationship between continuous signals and 
their discrete equivalent as a series of samples. 


12.1 Discrete-Time Signals 


A discrete-time signal is represented by a sequence of numbers that is called a tame 
series. There is no smooth transition between the numbers. Figure 12.1 shows 
the conventions we will use to represent such signals; in order to distinguish them 
from continuous-time signals, we put the independent variable in square brackets. 
In many technical applications, a discrete-time signal arises from the sarnpling 
of a continuous-time signal £(t), where a sample is taken from 2(¢) at regular 
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intervals T and is translated as a numerical value 2[k]: 
z[k] =&(kT), ke Z. (12.1) 


Here it is essential to distinguish the discrete signal x|k} from the sampled signal 


Ca) = z(t) , atl (;) = S* &(kT)O(E —kT) 
k 12.2 
= So alklo(t- kT), tel a 
k 


introduced in Chapter 11. The dependent variable t is defined for every point in IR, 
although x, (t) is zero for almost all of these time-points (except for ¢ = kT, k € Z). 
In contrast, z[k] is only defined where the index & is an integer, so integration of 
alk] is not possible, and the Fourier transform from Chapter 9 cannot be used. 
In the following sections we will deal with discrete signals in depth without being 
limited to sequences of sampled values, instead we will consider general time- 
series x[k}. We will return to using sampling in Section 12.4. The values ak] 


x[k] 


-1 
Figure 12.1: Representation of a discrete-time signal 2k] 


are themselves continuous and in general, they could also be complex: z[k] € C€. 
Strictly speaking, this is not the case if the series is going to be processed with 
a computer. The finite word length means that numbers can only be recorded 
within the limits of the number representation being used, and the values ak] 
then become themselves discrete. To distinguish them from the discrete signals 
with continuous values, we refer to these signals as digztal segnals. 

Rounding to discrete values is a non-linear process and is called quantisation. 
Processes involving digital signals therefore cannot be described by LTI-systems. 
A computer with sufficiently great word length can work with digital signals that, 
are so finely quantised, however, that they can approximate discrete signals with 
continuous values. We will therefore restrict ourselves to discrete signals from now 
on. 


: ; . : ¢ 
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12.2 Some Simple Sequences 


In this section we will be dealing with some simple discrete signals; we already 
know their continuous-time counterparts. These signals are the impulse, step and 
exponential series. 


12.2.1 Discrete Unit Impulse 


The discrete unit impulse is defined by 


1, k=0 
Pfs] aes 3 95 
5[k] = { 0 ke z\{o} | (12.3) 


afk] = > alkld[k — x], | (12.4) 


that can be easily checked. 


Figure 12.2: Discrete unit impulse 


Comparing this with the selective property of the continuous-time delta impulse 
shows a close relationship between the two: 


OO 

iss | a OoG = ede. (12.5) 
Fm OOD 

Integration with respect to the continuous variable rc in (12.5) corresponds to 

summation with respect. to the discrete independent variable « in (12.4). We 

will see that replacing integration in the definition of a continuous signal with 

summation often leads to the equivalent discrete signal. 

There is a more significant difference between the discrete unit impulse and the 
continuous delta impulse: the unit impulse 6/k] is not a distribution. For k = 0 it 
has the finite value 6[0] = 1, which makes calculations. simple. In contrast to the 
continuous delta impulse 6(¢), the unit impulse 6[k) can be directly inserted into 
a formula and does not require the use of the selective property. 
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12.2.2 Discrete Step Function 


The discrete unit step function from Figure 12.3 is defined by 


(12.6) 


The relationship between the unit step function and the unit impulse corresponds 
to the equivalent for continuous signals: 


(12.7) 


| stK) = [k| ~ elk -1). | (12.8) 


Integration in the continuous case corresponds to discrete summation and differ- 
entiation of continuous signals corresponds to subtracting the neighbouring value 
in the discrete case. 


elk] 
1 
eee eae 
k 


Figure 12.3: Discrete unit step function 


12.2.3 Exponential Sequences 


Exponential sequences are in general complex sequences of the form 


a[k] = X eLEHIQVE (12.9) 


X ig the complex amplitude, = is the damping constant, and © is the angular 
frequency. Discrete exponential sequences are often characterised directly by giv- 
ing their base, especially if they will be interpreted as the impulse response of a 
discrete system. 
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Figure 12.4: Examples of exponential sequences 


Example 12.1 


Two examples for unilateral exponential sequnces with real values are given by 
(12.10) and (12.11), and illustrated in Figure 12.4. 


: 
re (3) c[k] (12.10) 


x2[k] = (- | e{k] (12.11) 


For both exponential series X = 1 and i = —In2. The angular frequency © has 
the values 2 = 0 and 9 = x respectively. Both series are the same except the 
sigus before the odd values. 


In contrast to continuous exponential functions, different values of the angular 
frequency © can lead to the same exponential series. As e?°” is only evaluated for 
integers k, adding multiples of 27 to Q does not change the sequence: 


elk aa el(O For ii (1242) 
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Q=0.20 L=—-0.1 


10 Wyveet, 
Re{xlk]} 
A 
' Im{afk}} Q=1.9% T=-0.1 


4 
a 


Fie: 


AE ae YwettT Prog. ie 
20 E 


Figure 12.5: Examples of complex exponential series 


Example 12.2 


The exponential function in Figure 12.5 illustrates the ambiguous character 
of (12.12): the wpper curve has been calculated with an angular frequency of 
Q = 0.27. Increasing & by 1 turns the value of the series by 0.27 rad in the 
mathematically positive direction (rom the real part to the imaginary part). For 

>= 10 the same direction as for k = 0 is repeated because 10Q = 27; the absolute 
value is reduced to exp(—0.1x 10) = 1/e, however, because of the damping constant 
“= —0.1. 

In the lower curve the angular frequency is 2 = 1.97. The series makes almost, 
one full turn each time, as Q is only 0.1¢ rad less than a whole circle. In comparison 
to the upper curve, the lower curve does not seem to have a higher frequency, but 
instead, a lower frequency, turning in the opposite direction. The exponential 
series with angular frequency Q = 1.97 is identical to the exponential series with 


angular frequency Q = 1.9% — 27 = —0.1a7. We already know this phenomenon 
from western movies, when the wheels of a wagon appear to be turning backwards. 


The ambiguousness of the frequency of discrete exponential functions is the 
reason for the occurrence of ‘Aliasing’ (compare Chapter 11.3.2), where sampling 
causes different frequencies to overlap. Because of this effect, for a spectral repre- 
sentation of discrete signals, it is necessary to limit the frequency-domain to the 
width 27. 
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12.3. Discrete-Time Fourier Transform 


It would be convenient to use the advantages oflooking at continuous-time sig- 
nals in the frequency-domain with discrete-time signals. To this end we will be 
introducing the discrete counterpart to the Fourier transform, the discrete-time 
Fourier transform (DTFT). As with the Fourier and Laplace transforms, its use 
in the frequency-domain requires an inverse transform, transform pairs, theorems 
and symmetry properties. 


12.3.1 Definition of the Discrete-Time Fourier Transform 


As a series x[k] is only defined for discrete values of k € Z, we cannot use the 
Fourier integral (9.1) introduced in Chapter 9. We therefore define the discrete- 
tame Fourser transform or the F,. transform as: 


X(e®) = F,{2[k]} = s ake J*S (12.13) 


k=—00 


It transforms a series x{k] into a continuous complex function of a real variable Q. 
X (e)") is also called the spectrum of a serves. In contrast to a continuous signal, 
it is periodic with 27, so 
X (e427) = X (eI), (12.14) 

This is easy to see, as each term of the sum in (12.13) contains a 27-periodic term 
eJk® Tn order to see this more clearly, we write e/” as the argument of the F, 
transform and define the Fourier transform over the unity circle of the complex 
plane. This convention will make the transfer to the z-transform easier. 

A sufficient condition to show the existence of the spectrum F,{2z[k]} is that 
the sum of the series a[k] is finite: 


S~ |a[k]| < 00. (12.15) 
k 


12.3.2 Inverse Discrete-Time Fourier Transform 


The definition of the spectrum of a sequence from (12.13) represents a Fourier 
series of X(e"). The period is 27 and the Fourier coefficients are the values xk. 
In order to recover the series z[k] from the spectrum X(e#**), we have to use the 
formula for finding Fourier coefficients. It consists of an integration of X (7° )ei*® 
over one period of the spectrum 


1 Ls : ‘ 
a{k] = = X (el) e7 a | (12.16) 


L. 


This relationship represents the inverse discrete-tume Fourver transform. 
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12.3.3 Common Discrete-Time Fourier Transform Pairs 


This section contains the Fourier transforms of the simple sequences discussed 
in Section 12.2. These were the unit impulse, unit step function and bilateral 
exponential series. As a concliding example we will determine the spectrum of a 
rectangle function. 


12.3.3.1 #, Transform of a Discrete Unit Impulse 


To calculate the F, transform of a unit impulse z[k] = d(k] we start with the 
defining equation of the F, transform, and insert the unit impulse. The result can 
be given immediately, using the selective property of the unit impulse: 


X(e@) = $7 Sao 1 (12.17) 
k 
We thus obtain the transform pair 
5[k] o--el. (12.18) 


The transform of a shifted unit impulse :c[k] = 6[k — x] leads to a linear change 
of phase as for a continuous-time signal: 


KEM) =) bkaae oO Se, (12.19) 
k 


and so the transform pair is 


| S[k ~ n] o—e 32 | (12.20) 


We can see that the transform pair (12.18) is a special case for « = 0. 


12.3.3.2  F, Transform of an Undamped Complex Exponential Series 


GQok 


To find the F, transform of an undamped bilateral exponential series , we 
start with the interesting relationship 
Se 90 = 2 $7 5(Q — 2av) (12.21) 
k v 


that we had derived from equation (11.7) in the last chapter. Now we are using it 
to determine the spectrum of a[k] = eF@*; 


ox) oO 
X (ei) = SO e HO-M0E — ae S* §(N—-No—Imk) . (12.22) 
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The transform pair is 


= 2-0 
ei20k 5» Iq >» 6(Q—Qy—20k) = us = ) (12.23) 


Ez -- OO} 


and states that the spectrum of an exponential series e7* is in fact a delta impulse 
at Q = Qo. The ambiguousness we discussed in Section 12.2.3 likewise applies to 
the spectrum of the delta impulse at Q = No +2rv, v € Z. The resulting impulse 
train in the frequency-spectrum can be elegantly represented using the sha-symbol 
we introduced in Chapter 11. The correctness of the transform pair (12.23) can 
also be confirmed simply by using the inverse F, transform on LLL (S582). 

A special case of (12.23) is the spectrum of the sequence x[k] = 1. If Qy = 0 is 
put into (12.23), the transformation yields 


a[k] = lo—e X(eI%) = In = 6(Q-2Qrk) = LLL (3) : (12.24) 


k=—00 


12.3.3.3 #, Transform of the Discrete Unit Step Function 


The discrete unit step function ¢[k] can be expressed as the sum of a constant 


term ; 
,(k] = rt —00 << k < 00 (12.25) 


and a bilateral step series with no middle value 


3 k>0 

ek] = (12.26) 
~t k<O0 

elk] = e,[k] + eg[k] . (12.27) 


The Fourier transform of the constant term ¢,[k] can be obtained directly 
from (12.24) 


F,{ex[k]} = 5 Fett} . juu-(s| (12.28) 


To determine the Fourier transform of the second term ¢2[k] we express the 
unit impulse é[k] by e2[k] 


6[k] = ea[k] — eo[k — 1). (12.29) 


Substituting (12.26) confirms this. 
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Using the laws of linearity and displacement from Section 12.5, we obtain 


F.{ea{k] —eo[k — 1} = F.{ea[k]} — Fe fe2[k -— 1)} = F, fe2[k]} —e IPF, Leak} } , 
(12.30) 
together with (12.18) we then obtain from (12.29) 


F.{eo[k]} — e 9° F, {eo[k]} = 1 (12.31) 
and from here we see that 


F, {eo[k]} = os (12.32) 


As we cannot divide by zero, (12.32) can only be used for Q 4 ...—27,0, 2a, 4z,.... 
If F,{¢2[k]} would contain delta impulses at these frequencies, they would have to 
be considered separately. With (12.26), however, ¢2[k] has zero mean and therefore 
there can be no delta impulses at Q = 2mv, v € Z. It should now be evident why 
we split e[k] up into e1[k] + €9[k]. By adding (12.28) and (12.32) together, we 
finally obtain from (12.27) 


afk] = elk] o—e X(e) = posn by ju ( 2 ). (12.33) 


We now compare this result with the Fourier transform of the unit step function 
in (9.92). We also found two terms there: onc delta impulse and a term for which 
$ = jw came from the transfer function of an integrator. With the F, transform, 
the discrete unit step function produces an impulse train instead of an individual 
impulse, The other term happens to be the transfer function of an accumulator, 
and we will show that it in fact represents the discrete counterpart of an integrator 
(see Example 14.5). 


12.3.3.4 FF, Transform of a Unilateral Exponential Sequence 


We will now find the F, transform of a unilateral exponential sequence a[k] = 


a®<|k) with a €C from the defining equation (12.13): 


x 
X(e) = = ate y (ae ™, (12.34) 
k=0 
We know that the sum of an infinite geometric series is 


Sige oer lal <1, (12.35) 


n=O 
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and from this we can directly obtain 


1 


x[k] = a*e[h] o—# X(ei®) = a, 


laJ< 1. (12.36) 
Figure 12.6 shows on the left, the first few values of this exponential series for a real 
a, and the right shows the magnitude of the spectrum. The spectrum is clearly 
periodic with period 27. As (12.36) does not converge for a = 1, the spectrum of 
the unit step function (12.33) is not contained in (12.36) as a special case. 


[x(e) 
xik| a=0,9 10 
0 5 40° k ee 0 er re 


Figure 12.6: Series z[k] and its magnitude spectrum |X (e?®)| 


12.3.3.5 F, Transform of a Rectangle Series 
We want to find the ¥, transform X(e") of a rectangle series with length N 


e for0<k<N-1 
elk| s= 


as shown in Figure 12.7. Inserting this into the defining equation (12.13) leads to 


x[k] 


Figure 12.7: Rectangle series of length N 


a finite geometric series 


N-1 
X(e!") = eT Ik = 
k=0 


t= eT IN 


Toe ee) 
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that can be rearranged as 


eI0F (eI OF _ 9~ JF cgay amt 2S) = 
Ree a ey ere sa aa (12.39) 
2 —e-I%) sin(>) 
The result is shown in Figure 12.8. 
jQQ = ; = 
[x(e/®)| Ni 5 + |x(el®)] N=20 


if 2 


0 an, 0 2m 


Figure 12.8: Magnitude spectrum of a rectangle series for different NV 


12.4 Sampling Continuous Signals 


Up to now, we have discussed sequences in general, without considering where 
they come from or what they represent. Now we will examine sequences z[k], 
that have come about from the sampling of continuous-time signals Z(t). The 
individual members of a series x[k| are the sampled values of the continuous-time 
signal (kT), as in (12.1). 

According to this simple relationship in the time-domain, a corresponding re- 
lationship in the frequency-domain should exist, that. means between the Fourier 
transform. of the sampled continuous-time signal and the spectrum of the discrete- 
time signal, 

The signal x,(t) derived from the continuous-time signal #(t) with ideal sam- 
pling (see Figure 12.9) will first of all be represented by an impulse train 


a(t) = &(t) - wlll (x) = S~a(kT)S(t ~ kT). (12.40) 


k 
We express the weighting of the delta impulses by the values x[k] of the discrete- 
time signal (see (12.1)) 


ta(t) = 5° al[h]o(t — kT). (12.41) 


k 
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Transforming a2,(t) with the Fourier integral (9.1) yields 


Co 
Xa(jw) = / S- a[k]5(t — kT )e~ 9°" dt (12.42) 
seers 
=¢ S alkene". 
k 


We see from comparison with the definition of the F, transform (12.13), that the 
spectra agree, if Q = wT is understood to be the normalised angular frequency: 


Xq(gu) = X(e"*), (12.43) 


The periodic Fourier transform of the sampled continuous-time signal w(t) is 
the same as the spectrum of the discrete signal w[k]. The dimensionless angular 
frequency 2 of X(e3") consists of the angular frequency w of X(e?”), normalised 
with sample interval T. The relationships between the continuous-time signal 
Z(t), the sampled continuous-time signal xo(t), the series of sampled values a[k' 
and their spectra are depicted in Figure 12.9. 


continuous signals discrete signals 


convert weights 


ideal sampler 


| of Oimpulses to 
X(t) numbers : x[{k] 
i : [7 [7 
X(jw) X,(jco) Pe x(ei2) 


with QewT 


Figure 12.9: Relationship between the F and F, spectrum 


The relationship between F and F.. spectra gives an important insight that 
allows us to transfer many important properties and theorems that apply to the 
spectra of continuous-time signals to spectra of discrete-time signals. In the follow- 
ing section the most important of these are given. It is easy to recognise that some 
theorems, for example, the similarity theorem, cannot be applied to discrete-time 
signals because of the sampling process. 
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12.5 Properties of the 7, Transform 


As the spectrum of a series can be viewed as a spectrum of a continuous-time 
signal that consists of weighted delta impulses, the similarity. differentiation, and 
integration theorems described in Chapter 9.7 are true for both F and F,. We 
will discuss the most important properties briefly. A summary of the properties 
of the F and F, transforms can be found in Appendix Appendix B.8. 


12.5.1 Linearity 


From the linearity of the summation in (12.13), it follows directly that the principle 
of superposition still applies to the F, transform, and from the linearity property 
of integration, the same is true for the inverse F, transform. 


| Fila {ikl + 6 g{kl} aF.{ fikl} +b F.4d g{kl} 
| Fue Fe) 4. dG(e)} = ce FF (092) 4 d FON G(e} . 
va (12.44) 


li 


Here a, 6, ¢ and d can be any real or complex constants. 


12.5.2 Shift and Modulation Properties 


A shift in the time-domain or frequency-domain behaves exactly as with the F 
transform or the Laplace transform. Inserting «/k — «] into the defining equation 
(12.33), 


alk — K] oe e IM" X(eF2) , (12.45) 


is obtained. The shift multiplies the spectrum of the unshifted sequence with a 
linear-phase term (sce Exercise 12.8), although the shift must be a whole number 
of sample values, i.e., « € Z. 

Likewise, a shift in the spectrum by angular frequency Qo corresponds to a 
modulation in the time-domain with this frequency: 


elQak alk] oe x (e020) | (12.46) 


This can also be shown using (12.18) (Exercise 12.8). 


12.5.3 Convolution Property of the 7, Transform 


Tt is useful to know, when finding the response of a discrete system to a discrete- 
time signal, that convolution in the time-domain corresponds to multiplication of 
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the two F, transforms. For a sequence, the discrete convolution is defined as 


yik] = afk] *A[k] = > x] h[k — «] | 
R= = 00 (12.47) 
= hikealhl = ie hin] alk — w]. 


Koo 


This will be more accurately discussed in Chapter 14.6. in connection with discrete 
LTLsystems. By inserting it into (12.13). it can be shown (sce Exercise 12.9), that 


ulk] = xlk] « h{h 
: (12.48) 
Y(e) = X (eI) H(eI®) 


12.5.4 Multiplication Theorem 


Multiplication in the time-domain leads, as expected, to convolution in the 
frequency-domain. As both convolution terms are periodic, the classic convolution 
integral would not converge. The multiplication theorem, however. fortunately 
contains cyclic convolution, which we already know from Chapter 11.2.4: 


fA] - g[k| oe + Fle?) @G(e3") = = | Fle \G(eF2— dy (12.49) 
—T 


This can be shown by inserting the right side in the definition of the inverse F, 
transform with the help of the modulation theorem (see Exercise 12.10). 


Example 12.3 


In Example 9.11 we saw that the duration of a signal under measurement de- 
termines the resolution of the spectral image of the measured signal. The influence 
of the finite duration of observation on the measured signal was described by mul- 
tiplying the signal with a finite window in the time-domain. The spectrum of 
the measured signal is then obtained from convolution of the original signal with 
the spectrum of the window. Long measuring windows are advantageous as they 
correspond to thin spectra (see Figure 9.20). 

The discrete case is exactly the same. Trimrning a signal to finite leneth can be 
described by multiplying it with a rectangle series of the desired length. The spec- 
trum of the observation window approximates the spectrum of the series (12.24). 
if the rectangle series is very long (see Section 12.3.3.5, Figure 12.8). A longer 
window of observation leads to a better frequency resolution. 5 
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12.5.5 Parseval Relationship 


The Parseval relationship can be obtained as a special case of the multiplication 
property with gik] = f*[k]: 


Ss If (KP? = ie J |F(e!@)/F dO. (12.50) 


Kaeo 


As with continuous-time signals, the Parseval relationship states that the energy of 
a time signal, defined here by summation of | f[k]|?, can also be found by integrating 
with respect to |F'(e7)/? in the frequency-domain. 


12.5.6 Symmetry Properties of the Discrete-Time Fourier 
Transform 


We define even and odd sequences so that the symmetry axis goes exactly throngh 
the element 2/0): 


Even sequences L|k] = to|—k] (12.51) 
Odd sequences ty{k] = —xy[—k]. (12.52) 


Accordingly, for odd sequences 2,,[0) = 0. Every sequence a[k] can be split into 
an even and an odd part: 


. 1 
talk] = 3 

2 1 2 
ty{k] = 3 Gc _ c(-k)). (12.54) 
Adding both equations confirms that: 


&q\k] + ty[k] = x[k}. (12.55) 


Generally, for complex valued signals x/k], the F, transform has the same pattern 
of symmetry as the ¥ transform (see Chapter 9.5): 
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ak} = Re{x,{k]} + Re{a,[k]} + glmi{a alk} + jim{s,[k]} | 
X(e?®) = Rel X,(e7%)} + Ref X,,(c!@)} + 7 Im{X,(e7)} +7 Im{X,,(e7%)} . 
~ | (12.56) 


Example 12.4 


We have already met the transform pair (12.24): 


i 


; Q 
] = Loe X(e!) = LL (=). 
fk] = Loe X(e!) = 1 (2 
As z[k] = 1 is real and even, we expect a real even X(e/) from scheme (12.56). 
In fact, iil (2) does turn out to be real and even. 


Example 12.5 


From (12.56), we expect conjugate symmetrical spectra for discrete-time signals 
with real values. In particular, 


Im{ X(e7@)} = —Im{X(e7F%)} (12.57) 
At the same time, however, the spectrum is 27 periodic, so 
Im{X(e?)} = Im{ X(eH2™))}, ve Z, (12.58) 


can only fulfill these conditions, for example, if Q = 7, for 


Im{X(e?")} = 0. (12.59) 
The spectrum of a series with real values is therefore real for 
Q=...—30,-7,7,37,.... The transform pairs (12.20), (12.33) and (12.39) 


confirm this. 
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12.6 Exercises 


Exercise 12.1 
Regular sampling with interval T = ri of the exponential function «(t) = elotqw)t 


gives rise to the exponential series z[k] = e+) *, Carry out the following steps 


separately for a) w= 27 and b) w = 10a where o = In rt 


e Give % and 2, and mark the sample values x[k] in the sketches of x(t). 


Exercise 12.2 
Determine the normalised damping constant © and normalised angular frequency 
: 
{2 of the complex exponential series a) e~2", b) 0.9", ec) (—0.9)*, d) 7*. e) (+) ; 
f) (—3)3*, g) 7®*, h) 7®*. For all parts, choose Q in the region [0; 27]. Which series 
are the same? 
Exercise 12.3 
Verify the inverse F, transform (12.16) by inserting the defining equation of the 
F, transform (12.13). 
Exercise 12.4 
us 

Calculate and sketch the F, transform of the series a[k] = si ak| using various 
methods. It will turn out to be the impulse response of an important system. 

a) Calculate F,{2[k]} with the defining equation (12.13). 

b) First calculate X,(jw) = F{aa(t)}, with vq(t) = So alt —kT) z[k] and then 

give F,{a[k]}. by using (12.43). Sketch the result. 


c) Show that results a) and b) agree, by finding the Fourier series of X(e!°). 
Note that in this case a fundamental period t) must be used, instead of a 
fundamental angular frequency wo, as it is a function of frequency that you 
will be representing as a Fourier series. 


d) What kind of filter has the impulse response x[k)? 


Exercise 12.5 


A low-pass filter with impulse response h,{k] has spectrum H,(e?"). One period 
has been sketched. By reversing every second sign of /y[k], a new filter is created 
with ho[kl = (—1)*hy|k}. Calculate and sketch H2(e3%). 
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What kind of filter is h2[k]? 


Exercise 12.6 


In the system shown below, the low-pass filtering of a continuous-time signal is 
carried out with the help of a discrete low-pass filter. The input signal a(t) is 


given by its spectrum X (jw). 
y(t) 
Hy(ja) 


Mt) (ideal |“ 


sampler 


(2) yA] y(t) 


0, -O of 2 


8 Wg/2 as) 


Converter 1 transforms the continuous-time delta impulse train «,(/) into a 
discrete-time series «[k], where the values of the series xk] are the weightings 
of the delta impulses ([k] = a(kT)). Converter 2 converts the discrete-time series 
yk] into the continuous-time signal y,(t) in the same way. 

The signal x(t) is sampled at the Nyquist frequency. 


1 l 


a) Give T and draw the spectrum of a(t) = «(t) - pills). 
b) Draw X(e?°) = F,{a[k]}. 
c) If ¥(e3%) = F,{y[k]}: 
Y(ei) = 0 for 2 <|Q<a 
¥(e) = T-X(e%) for jQ|< ; 


Determine and draw Hy (e7®). Draw Y,(ju:) eo yq(t). 


d) fHa(gw) is a RC-low-pass Nth- order filter with corner frequency Wy, and 


the pass section being amplified by a factor of 1. Give H2(jw) and determine 
N so that spectral repetition of the baseband (where |w| > wy) is damped 
by at least 18 dB. Note: see Chapter 10. 
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Exercise 12.7 

Show (12.23) by using the inverse F, transform on 11 (2522), 

Exercise 12.8 

Show by using the defining equation (12.13) of the F, transform, 
a) the shift theorem, 


b) the modulation theorem. 


Exercise 12.9 

Show the convolution theorem (12.48). You will need to use the convolution sum 
for f{k] * glk] and the defining equation (12.13) of the F.. 

Exercise 12.10 


Show the multiplication theorem (12.49), using the cyclic convolution integral and 
inverse transformation of the result with (12.16). 


13 The z-Transform 


In Chapter 12 we got to know discrete-time signals z[k] and their spectra X (e7®) 
in the form of the discrete-time Fourier transform F,{x[k]} from (12.13). The 
correspondence between the F, transform for discrete-time signals and the Fourier 
transform F{a(t)} for continuous-time signals can be expressed, for example, by 
the relationship (12.43). For continuous-time signals, however, we also know the 
Laplace transform C{a(t)}, which assigns a function X(s)e—ox(t) of the complex 
frequency variable s to the time-signal x(t). A comparable transformation for 
discrete-time signals is the z-transform. It is (clearly) not named after a famous 
mathematician, but instead after the letter normally used for its complex frequency 
variable: 2. 

Its discussion in this chapter will deal with the same topics as in Chapter 4. 
when we discussed the Laplace transform. From the definition of the z-transform, 
we first of all find the relationship between the z-transform and the Fourier trans- 
form, and then the relationship between the z-transform and the Laplace trans- 
form. After that, we consider convergence, and the properties of the z-transform 
and inverse z-transform. 


13.1 Definition and Examples 


13.1.1 Definition of the Bilateral z-Transform 


The general definition of the z-transform can be used with a bilateral sequence 
z[k] where —90 < k < oo. It is 


X(z) = Z{alk}} = S° afkle-*; ze ROC CC. (13.1) 


k=—-0o 


It represents a sequence z[k], which may have complex elements, by a complex 
function X(z) in the complex z-plane. The infinite sum in (13.1) usually only 
converges for certain values of z, the region of convergence. 

We can think of (13.1) in two ways: by comparison with the Laurent, series of 
a function of a complex argument (see (4.15)), we recognise that the values of the 
sequence «/k] represent the coefficients of the z-transform’s Laurent series at the 
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point z) = 0. We can therefore take many properties of the z-transform directly 
from the known properties of the Laurent series. 

For the second interpretation we need a result from Chapter 14. ‘There we will 
see that. the sequence 2” is a characteristic sequence of a discrete-time LTI-system. 
It is the discrete counterpart to the eigenfunctions e*! of the continuous-time LTI- 
system from Chapter 3.2. The z-transform projects a discrete-time signal onto 
the characteristic series of an LTI-system. We will see that we can therefore form 
the inverse z-transform by overlapping the characteristic sequences of which the 
signal is made up. 

The transform pairs of a sequence xk} and its z-transform X (z) is again written 
with the familiar symbol 


alklo—-eX(z) . 
As we discussed in Chapter 9.2.1. it has no mathematically strict meaning, and is 
used simply as a typographical symbol. 
13.1.2. Examples of the z-Transform 


We will now show the properties of the z-transform with some simple examples. 
paying particular attention to the convergence properties of the sum in (13.1). 


— ~ Example 13.1 


We begin by calculating the z-transform of a sequence of finite length from 
Figure 13.1: 


3 k=0 
’ 2 |kl=1 
xlkl=4 5 a (13.2) 


0 otherwise 


Bae 


“eure 13.1: Discrete triangular sequence «{k] from Example 13.1 
Figure 13. iscre g i} j I 


As only a few values of the series are not zero, we can write down the sum 
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in (13.1) directly 


X(z) = 27422484227! 4277 = - ; : - where 0 < |z| < oo. 

(13.3) 
In the rational representation of the function of z, we obtain a denominator poly- 
nomial with a double zero at z = 0. As the sum in (13.1) only has a finite number 
of terms, it remains finite for all 0 < |z| < oc. The region of convergence of the 
z-transform X(z) therefore encloses the entire complex plane with the exception 
of the origin. 


Example 13.2 


We have already met exponential sequences in Chapter 12.2.3. We will now 
find the z-transform of a general right-sided exponential sequence 


alk] =a*.e[k], ae. (13.4) 
Figure 13.2 shows its behaviour for a = 0.9e27/® (compare Figure 12.4). 
Re{x{k]} 


Im{atk]}} 


ie ee 


4 12 ia a, 2 eo ee: ’ 
ae 


Figure 13.2: Example of a right-sided exponential series 


From the defining equation (13.1) we obtain 
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= : (13.5) 

k=l k=0 * 
The infinite sum only converges for |a| < |z|. which means all values of z in the 
complex plane that lie outside a circle with radius |a|, This region of convergence 
is the hatched area, shown in Fig 13.3. The z-transform has a zero at z = 0 anda 
pole at 2 = a. The circular boundary of the region of convergence is determined 
by the magnitude of the pole. 
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Figure 13.3: Region of convergence of the function X(z) from Example 13.2 


For a = 1 the sequence x/[k] represents the unit step function e[k]| from (12.6). 
Its z-transform is 


= i 


Example 13.3 


The z-transform of the a left-sided exponential sequence from Figure 13.4 


a|k] = —a*-e[-k~1], ae€ (13.7) 
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Figure 13.4: Example of a left-sided exponential sequence 


This sum converges for |z| < ja], which means all values of z in the complex 


plane that lie within a circle of radius a (see Figure 13.5). The boundary of the 
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Figure 13.5: Region of convergence for the function X(z) from Example 13.3 


region of convergence is circular here too, and its radius is equal to the magnitude 
of the pole. 

In comparison to Example 13.2, we notice that the z-transform of the right- 
sided exponential sequence (13.4) and the left-sided exponential sequence (13.7) 
have the same form and only the regions of convergence are different (Figures 13.3 
and 13.5). This emphasizes how necessary it is to specify the region of convergence. 
Without it, a unique inverse transformation is impossible. 

We are familiar with this situation from the Laplace transform. In Exam- 
ples 4.1 and 4.2 we considered left-sided and right-sided continuous-time signals 
that are likewise only distinguished by the region of convergence (see Figures 4.3 
and 4.4). 


13.1.3 Dllustrative Interpretation of the z-Plane 


We can interpret the individual points of the s-plane in a similar way to the s- 
plane in Chapter 3.1.3. Figure 13.6 shows the corresponding exponential sequence 
2* for different values of z. 

The values z = e7? on the unit circle correspond to the exponential series 
e)* with constant amplitude: z = 1 leads to a series with constant values because 
eJ0k — jk — 1, while x = —1 is the highest representable frequency, because 
elt — (—1)*. All other values on the unit circle represent complex exponential 
oscillations of frequency 2 with —-1 < 2 < a. Complex conjugate values of z 
are distinguished by the direction of rotation. Values of z = re’? within the unit 
circle (7 < 1) belong to a decaying exponential sequence and values outside the 
unit circle (r > 1) belong to a growing exponential sequence. In Figure 13.6 the 
exponential series z* are each only shown for k > 0. This should not lead to the 
misinterpretation that we are only dealing with unilateral sequences, since also for 


B<0, 2 £0. 
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The reader is recommended to memorise the illustration of the z-plane (Fig- 
ure 13.6). It can be the key to intuitive understanding of the properties of the 
z-transform and the system function of discrete LTT-systems. 
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Vigure 13.6: Thustration of the z-plane 


13.2 Region of Convergence of the z-Transform 


We can draw up rules for the region of convergence of the z-transform that are 
very similar to the corresponding rules for the Laplace transform in Chapter 4.5.3, 
where we explained the properties of the Laplace transform’s region of convergence 
with a series of examples (Examples 4.1 to 4.5), We could also do this in the case 
of the z-transform; Examples 13.2 and 13.3 actually correspond to Examples 4.1 
and 4.2 respectively. We will, however, forgo continuation of the examples for 
discrete-time functions, and will just give the rules for the region of convergence 
in a general form. ‘They each refer to a sequence x[k] and its z-transform X(z) 
from (13.1). 


13o2s 
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1. 


3. 


The region of convergence X(<) in general consists of a circle 
around the z~plane origin at z= 0. 


As only the magnitude of z is responsible for the convergence of a z- 
transform. all points on the z-plane with the same magnitude have the same 
convergence properties. This result is also yielded by the known convergence 
properties of the Laurent serics. 


If z[k] is a right-sided signal, the region of convergence lies outside 
a circle through the singularity furthest from the origin. 


In Example 13.2 we saw that for a right-sided exponential series, the magni- 
tude of the pole defines the region of convergence. Similarly, for right-sided 
series with multiple singularities, it is the singularity that lies furthest from 
the origin. The circle itself is not part of the region of convergence. 


If xk] is a left-sided signal, the region of convergence lies within a 
circle through the nearest singularity to the origin. 


The magnitude of the pole also defines the region of convergence for the 
left-sided exponential series from Example 13.3, although in this case it lies 
within a circle through the pole. For left-sided series with multiple singular- 
ities this is true for the singularity nearest to the origin. The border itself is 
not part of the region of convergence. 


If xk] is bilateral, i.e. the sum of a left-sided and a right-sided 
series, then the region of convergence is an annulus between two 
singularities, if the left-sided and the right-sided regions of con- 
vergence overlap. 


Every bilateral sequence can be formed by putting together a left-sided and a 
right-sided part. ‘The individual regions of convergence for the z-transforms 
of each part can be found from rules 2 and 3. For a bilateral sequence 
the region of convergence consists of the intersection of the left- and right- 
sided parts. This intersection is an annulus whose inside border is set by 
the outermost singularity of the right-sided term. and whose outside border 
is set by the innermost singularity of the left-sided term. If singularities 
from the right-sided part lie outside singularities from the left-sided part. 
the intersection is empty. and therefore the z-transform does not converge. 
In this case we say the the z-transform does not exist. 


X(z) is analytic in the entire region of convergence. As the circular 
region of convergence is bounded on the inside by the singularities of the 
right-sided part. and on the outside by the singularities of the left-sided 
part. it contains no singularities itself. ‘The z-transform is analytic in the 
entire region of convergence (it is also said to be regular, or holomorphic). 
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This means that it can be repeatedly differentiated, and can be interpreted 
as a Laurent series. 


6. If the sequence 2[k| is of finite length, X(z) converges in the entire 
z-plane, except possibly for z = 0 and z —> ox. 
In Example 13.1 we saw that a sum of a finite number of terms yields a 
finite number. A precondition of this is that all members of the series z[k] 
are finite: |a[k]! < oo and 0 < |z| < oo. The convergence for z = 0 and 


z= 90 depends on whether the series «[k| contains non-zero values for k > 0 
and k <0. 


13.3 Relationships to Other Transformations 


Close relationships exist, between the z-transform aud other transforms we already 
know. 


® The z-transform and the Fourier transform 7, of a series are closely 
connected, like the Laplace transform and the Fourier transform F of a 
continuous-time signal (see Chapter 9.3). 


® Ifa sequence z[k] has been created by sampling a continuous-time signal z(t), 
the values of x{k] can be interpreted as the weightings of individual impulses 
in an impulse train (see Figure 12.9). Between the Laplace transform X(s) = 
Li{a(t)} and the z-transform X(z) = Z{2/k]} there niust likewise be a close 
connection. 


We will now examine more precisely these relationships between the individual 
transforms. 


13.3.1 The z-Transform and Discrete-Time Fourier Trans- 
form 
When the z-transform of a sequence xk] is only calculated for values z on the unit 
circle 
za=e, OER, (13.9) 
the Fourier transform of this sequence is immediately obtained. By comparing the 


instructions for calculating the z-transform and the Fourier transform we recognise 
that 


Z{alk]} = 5° alkl2-* Filalkl} = S$" alkle (13.10) 
k 


k 


We have now found the relationship between the two transformations 


[ Few lkl} = ZECIAT} lees - | (13.11) 
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This relationship corresponds to the relationship between the Fourier transform of 
a continuous signal and its Laplace transform (9.9). It also becomes clear why the 
Fourier transform X(e!*) is not simply defined on the real axis 2, but instead on 
the unit circle e/. For the discrete-time Fourier transform, the unit circle of the z- 
plane is the equivalent of the imaginary axis of the s-plane for the continuous-time 
transform. 
This relationship can be generalised if we consider the circle of radius r de- 
scribed by 
zg=rl% O0<r<oo (13.12) 
instead of the unit circle on the z-plane. For all values of z in (13.12), the 2z- 
transform of z[k] can be given as the Fourier transform of the series z[k]r—*: 


X(z) = X (re) = ~ a[k](re?@)—* = So alkr Fe IO (13.13) 


k k 


This yields therefore 
F,{al[k]r—*} = Z2{a[k]} |areia - (13.14) 


The relationships (13.11) through to (13.14) only have meaning if, of course, 
the Fourier transforms of «{k] and a[k]r~* exist, and the unit circle of the z-plane 
or circle with radius r, belong to the region of convergence of the z-transform. 
If the unit circle does not belong to the region of convergence of the z-tranform, 
that does not necessarily mean that the Fourier transform does not exist, instead 
that the Fourier transform is not analytic. There are actually even sequences that 
have a Fourier transform but not a z-transform, for example, z[k] = 1. If on the 
other hand, the z-transform convergences on the unit circle, the Fourier transform 
X(e3") can be analytically continued when e?® is replaced by z. The observations 
made about Fourier and Laplace transforms in Chapter 9.3 also apply in this case. 


Example 13.4 


What is the z-transform of the series which has Fourier transform 
X(8%) = 1+ cos? 
X(e/") can be differentiatied with respect to Q any number of times, and is 
therefore analytic, when we replace e/® by 2. With 
vf pI2 | Le ee ery 
A(e™) =1+cosQ=1+4+ 3° + 5° 


we obtain 
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The region of convergence is the whole z-plane excepting z = 0. z = 20. and we 
must therefore be dealing with a series of finite length. Equating coefficients (13.1) 
yields directly 


1 
_ k = —i 
2 
Lt k=0 
ak] = 1 
ae 
0 otherwise 


13.3.2 The Transform and Laplace Transform 


The relationship between a sampled continuous-time signal x,(t) and the series of 
sample values 2:[k| from (12.2) and Figure 12.9 is 


Za(t) = > - afk]o(t — kT). (13.15) 


k 


T is the sampling interval. The Laplace transform is found with the help of the 
selective property of the delta impulse 


Li{xa(t)} 


Oo 
I S t[k]d(t — kT edt = N° akon? = 
k 


k 


= Soke = 2k) with ge. (13.16) 
k; 


or concisely 
X,(s) = X(e8*). (13.17) 


The z-transform X(z) of the sequence z[k] is therefore the same as the Laplace 
transform of the sampled continuous-time signal x, (t) for 


Fae (13.18) 


In order to better understand this relationship between the complex frequency s of 
a continuous-time signal and the complex frequency <z of a series, we will represent 
it as a projection from the s-plane onto the z-plane. Figure 13.7 illustrates the 
geometric relationship for a Laplace transform which contains the imaginary axis. 
The assignment (13.18) represents the: 
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® imaginary axis s = jw of the s-plane as the unit circle s = e/ of the z-plane. 
e the left half of the s-plane as the area inside the unit circle on the z-plane, 
e the right half of the s-plane as the area outside the unit circle on the z-plane. 


If the region of convergence of the Laplace transform contains the imaginary 
axis of the s-plane (as shown in Figure 13.7), then the region of convergence of 
the z-plane contains the unit circle. 

The way the imaginary axis of the s-plane is projected onto the z-plane as the 
unit circle is of particular interest. This projection obviously cannot be inverted, 
as all of the points 


27 


Sy = jpeg With We = Fe BEE 
of the s-plane would be projected onto the point 


Poi eitwel oo gO Vi 


Oi. ioe e>e 


aa 


of the z-plane. Correspondingly the points 


8p = 7(Vwy + wo) 
would be projected onto 


a ete?  civwaT+woT) _ p3woT _ We. 
The frequency w. = 2r/T is just the angular sampling frequency (see Chap- 
ter 11.3.4). 

Through the projection (13.18), the imaginary axis ¢ = jw therefore becomes 
transformed to the unit circle of the z-plane, where the circumference of the unit 
circle corresponds to a section of the imaginary axis which has the same length as 
the sampling frequency w,. The central statement of the sampling theorem can 
be constructed directly from the definition of the projection (13.18). 

The properties of the projection (13.18), projecting a vertical line in the s- 
plane onto a circle in the z-plane are the same for the imaginary axis as for any 
straight line parallel to it. From s = o9 + jw with a fixed value of oy, it follows 
with (13.18) that 


gx pltIw)T . pple 


€ where =e", (13.19) 


Variation of the values of w describes z (13.19) as a circle about the origin with 
radius r. Vertical lines in the left half of the s-plane are projected into the inside 
of the unit circle of the z-plane (see Figure 13.7) and lines in the right half are 
projected to the outside of the unit circle. 

The Laplace transform of the sampled continuous-time signal (13.1 5) is periodic 
with the sampling frequency wy = 20/T in w. as ew stead kT & eo 8T for mc Z 
in (13.16). The values of X,(s) within two adjacent dashed lines in Figure 13.7 
are therefore repeated above and below. After the transform z = e®? (13.18) every 
horizontal strip covers the whole s-plane. 


326 13. The z-Transform 


z plane 


i; tio unit circle ‘Im 


oe 4 jo- axis 


sT=taj, £30), ... sT=0, +2, s4 aj, ... 


Figure 13.7: The relationship between the z-transform and the Laplace transform of a 


sampled signal. The s-plane has been projected onto the z-plane with z = e°". 


Example 13.5 


The z-transform of the discrete unit step function e[k] (13.6) is 


ra 


Z{elk]} = ee ered. 


We now arrive directly at the Laplace transform of the continuous-time signal 


Oe 5 al ee (« i 5) . LLL (t) 


k=0 2 
by setting z = e*. 


or Xa(s) = ~——, Re{s}>0 


13.4 Theorems of the z-Transform 


The same holds for practical application of the z-transform as for the Laplace 
transform, which we have already covered. Calculating the z-transform of a se- 
quence by evaluating the summation formula (13.1) only leads to (13.3) for very 
simple sequences «[k} (compare Example 13.1). For other cases, we try to refer to 
these simple series by using some general rules. These general rules will be sum- 
marised by a series of theorems that have a lot of similarities with the theorems 
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of the Laplace transform (see Chapter 4.7). That is no coincidence, as we saw 
in Section 13.3.2 that the z-transform of a series can be thought of as a sampled 
continuous-time signal consisting purely of delta impulses. It should be clear that 
many properties of the Laplace transform also apply to the z-transform. 


The most important theorems of the z-transform are summarised in Table 13.1. 
They can also be shown without referring to the Laplace transform by inserting 
them into (13.1). In contrast to the theorems of the Laplace transform, the inde- 
pendent variable is defined only for integer values. In the square brackets [ |, no 
real values are permitted, and correspondingly, for the shift theorem, only integer 
shifts « € Z are allowed. As for the similarity theorem (4.24), for sampled signals 
the only scaling of the time axis that is permitted is a = —1, so that becomes 
the time reversal theorem for the z-transform. Reversing the index of a series of 
values can be done simply by reading them backwards. 


Table 13.1: Theorems of the z-Transform 


Theorem Time-domain z-domain New ROC 


Linearity az[k] + by[k] | aX (z) + bY (z) | ROCD ROC{e}n ROC{y} 


ROC{x}; 2 = 0 and z — 
Shift alk — K] 27 8X (2) 0 
considered separately 


Modulation a alk] x (:) ROC = {2 F € ROC{a}} 
a a 

Multiplication er(h] aX (z) ROC{z}: z= 0 

by & on “dz considcred separately 


Time reversal x[—k] X(z-1) ROC = {z]z7! € ROC{z}} 
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Example 13.6 


As an example we will show how the shift theorern of the z-transform can be 
derived from the shift theorem of the Laplace transform (4.22) 


Liaa(t — c)} =e ** X,(s).  s © ROC{z}. 


We make w(t) a sampled continuous-time signal, that consists of delta impulses 
with separation T = 1 (13.15). As we want to fix the location of the sample 
points in time, only displacements of ¢ © Z are permitted. The 2-transform 
X(z) of the series a[k] that corresponds to x_(f) can be obtained with (13.17) as 
X(s) = Xa(s)|,..),-, and it then follows that 


Z{a[k — c]} =e OO EX (nz) = 27 FX(2). 
The region of convergence of this z-transform might only change at the points 


z= O0and z = oo. Of course, the shift theorem can be just as easily shown by 
putting a[k — z] into the definition of the z-transform: 


Z{alk—<} = Soalfe—de* = So alge? 
k é 
= ory aide 
€ 


a © Zi elk] | 
Note that delaying a discrete-time signal by one sample corresponds to multiplying 
by <7!. This makes -~+ the system function of a simple delay circuit and the most 
important and elementary transform for the analysis of discrete-time systems, 
which we will deal with in Chapter 14. 


\ 


13.5 Inverse z-Transform 


In Section 13.1.1 we interpreted the z-transform X(z) as a Laurent series with 
coefficients given by the values of the sequence 2[k]. To invert the z-transform 
a[k] = Z7~!{X(2)}, we can therefore use the formula that calculates the coefficients 
of a Laurent series: 


z[k] = -— § Xa lds =: Z'{X(z)}. (13.20) 


The integration follows a closed path around the origin, in a mathematically pos- 
itive direction. The path of integration must both enclose the origin and stay in 
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the region of convergence of X(z). If the series z[k] has finite length, it is very 
simple to find (13.20) from the Cauchy integral (5.13) and the resulting residue 
calculation (Chapter 5.4.1). In the expression 


Rie S> a[xje "e*o) = S a 
a 


& 
every term within the path of integration is analytic with the exception of poles at 
= 0. From (5.21) it follows that only the simplest pole z[a]z7! for « = k gives 
a residuum. and for all other terms the ring integral is zero: 


= { alklz—'dz = 2r7a[k] (13.21) 


For a general bilateral series z[k] with singularities within the path of integration, 
a{k} must be split into left-sided and right-sided series and with suitable substi- 
tution z — 27) the conditions for (13.21) must be met. Then (13.20) can also be 
shown generally, 

Similar to the inverse form of the Laplace transform (Chapter 4.2). we can inter- 
pret (13.20) as a superposition of complex exponential series. In Chapter 14.4 we 
will show that complex exponential series are characteristic sequences of discrete 
systems and that the z-transform is therefore particularly suitable for investigating 
and describing such systems. 

For the case where the region of convergence encloses the unit circle of the 
z-plane, an inverse formula can be created by parametricising the unit circle with 


eae 4 <Q<o (13.22) 
which only requires one integration of a real variable. From (13.22). with differ- 
entiation, we obtain 


dz = je? dQ). (13.23) 
Substitution of z into (13.20) then vields 
| 1 i 
elk) = —— b X(eiM eID ge = Ff pJ2) pI@k ag | 13.24 
elk] = 5 $ X (ei). a [ X(eelan (13.24) 
_—T 


This is exactly the same as the inverse formula for the Fourier transform (12.16)! 
But since we find the Fourier transform of a series on the unit circle of the z-plane, 
it is of course no longer surprising. 

Just as with the inverse Laplace transform, we avoid evaluating an integral 
expression for the inverse z-transform if there are simpler ways of recovering the 
series z[k]. ‘These methods exist for rational fraction z-transforms, which are the 
kind we most often encounter, and they are 
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@ for sequences of finite length, assigning each term in the sequence a power 
of z (compare Example 13.1), 


@ for sequences of infinite length. decomposing the z-transform into known 
expressions, for example, with partial fraction expansion. 


It would be useful to know from looking at a z-transforrn, whether it corresponds 
to a finite or infinite series. We put X(z) in rational fraction form and consider 
the denominator polynomial: 


e If the denominator polynomial of Nth-order is <% (it only has one zero N 
times at z = 0), then X(<) can be written as a Laurent series with a finite 
number of terms. The values of «/[k:] can be read directly. 


e {f the denominator polynomial is a general polynomial in z, where, apart 
from z‘ there are also lesser powers, then it also has zeros outside the origin 
of the z-plane. Partial fraction expansion for these zeros yields a sum of 
terms similar to (13.5), where each has an exponential sequence The exact 
form of the exponential sequence depends on the region of convergence of 
X(z) (compare Examples 13.2 and 13.3). 


We will deal with both cases with an example. 


a Example 13.7 


The z-transform 


X(z) = — (13.25) 


/ 


only has a double pole at z = 0 and no others. The corresponding series x[k} can 
therefore only have a finite number of non-zero values. By dividing we obtain 


X(z)= s, a|[kjz~* = 3274+54+3271 -—5277. (13.26) 


3 k= —2 
5 k=0 

alk] = 27! {X(z)} = 3 Reed! (13.27) 
—5 kg 


Q otherwise 


Figure 13.8 shows the series x[k] obtained from X (2). 


13.5. Inverse 2-Transform 331 


x[k] 
5 
3 
LIL: 
” — eee hole OQ prciensiiate = en: ~e--- ad 
~3 -2 ~1 | 3 4 & 
atl 


Figure 13.8: Series z[k) obtained from X(z) in Example 13.7 


Example 13.8 


The z-transform ; 
z+ 


~ 225241? 


has two numerator zeros (poles) outside the origin of the complex plane: 2* — 
2.02 +1 = 0 gives 7) = 4, Zpq = 2. As the region of convergence lies outside a 
circle around the origin, we expect a right-sided series x[k] = Z~'{X(z)}. If it is 
possible to express X(z) as the sum of two terms (like (13.5)), we can assign each 
term an exponential oscillation. Direct partial fraction expansion does not lead to 
the goal as it produces a sum of the form 


~ 
a 


2 (13.28) 


A; A 
XOeAgh =e (13.29) 
Z~-Uyy 2-2 
while we need an expansion 
z z 
X(z) = Bo + By-——— + Bo (13.30) 
2 By 2 np 


to determine the exponential terms. Here it helps to expand X(z)/z into partial 
fractions, instead of X (2). 


X(z z+1 B B B: 
(2) _ se ep (13.31) 
ze afz—a)(2-2) 2 emg oz 


Determining the partial fraction coefficients, for example, by equating coefficients. 
leads to Bo = 1, By = —2 and By = 1. Multiplying by = and term-by-term 
inversion aided by Example 13.2 yields the series 


(13.32) 
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alk] = d[k}-—2 e[k| + 2¥e[k]. (13.33) 
i 


13.6 Pole-Zero Diagrams in the z-Plane 


As with the Laplace transform of continuous signals, with the z-transform of dis- 
crete signals, rational fractions often appear. They correspond to system functions 
of discrete LTI-systems with a finite number of internal state-variables, which we 
will discuss in detail in the next chapter. Rational fraction z-transforms are ~ ex- 
cept for a scaling factor - completely defined by their poles and zeros and can be 
represented by a pole-zero diagram in the z-plane. As we have already mentioned, 
the z-transforms of signals of finite duration only have poles at the origin of the 
z-plane, while signals of infinite duration can have poles at any other points. 


Example 13.9 


The pole-zero diagram of the z-transform from Example 13.7 has a double pole 
at the origin and two complex conjugate zeros that are shown in Figure 13.9. 


Tm{<} 


Figure 13.9: Pole-zero diagram for (15.25) 


—— Example 13.10 


The pole-zero diagram of the z-transform from Example 13.8 has two real poles 
and one real zero (Figure 13.10). 


Se | 
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Im{z} 


Figure 13.10: Pole-zero diagram for (13.28) 


With the rules in Chapter 10 (Bode Diagrams) the magnitude and phase of the 
Fourier transform can be estimated from the pole-zero diagram of the z-transform 
after some practice. Unlike Chapter 10. however, the unit circle of the 2-plane is 
used and not the imaginary axis of the s-plane, and it is the angle and distance 
to the poles and zeros that mnst be determined. Otherwise the procedure is the 
same. 


i nrrenrnneenmneraenrcrereceereneececeaen A Xample 13.11 


We want to find the frequency response of a system with the pole-zero diagram 
shown in Figure 13.10. We can find it from the pole-zero diagram up to a factor 
K. 


Ql] K-|X(ei)| 
esenens —} 5 
0 a 
1/2 5c] 
wT 1.8 
ee 1 
4} 0.7x1.5 
T 1.4 
k- ~ 0, 
anes ae 
on 0.7 
ciel eer ae ~ 0.15 
eV geeg 
T 0 
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Figure 13.11: Exact frequency response to (13.28) and the estimate from the pole-zero 
diagram 


Substituting z = 1 into (13.28) gives K = ~—1. The estimates are shown in 
Figure 13.11 with the exact result for comparison. Zeros lying directly on the unit 
circle force the magnitude of the Fourier transform at this frequency to zero, and 
poles lying near to the unit circle increase the resonant peak. The nearer to the 
unit circle that a pole or zero lies, the greater effect it has on the Fourier transform. 
Poles or zeros at the origin of the z-plane have no influence on the magnitude of 
the Fourier transform, but they do make a linear contribution towards the phase. 


13.7 Exercises 


Exercise 13.1 

Evaluate the z-transforms of 

ayi(k] = d[k — 3] — 40[k -- 2] + 66[k — 1] — 46[k] + d[k + 1) 
zo[k] =e **e[k—- 21, a el 


ay § (-0.8)") for [kl < 10 
mlel , 0 otherwise 


using the defining equation (13.1). 


Exercise 13.2 
Evaluate the 2-transforms of 
ak] = a *e[k] 


xo[k] = —a-*e{—k] 

ag3[k| = 27*e[k] + 0.8%e[—k] 
aa[k] = 0.87*e[k] + 0.5" 2[—k] 
r|k) = all a@eiR,a>0 
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and give the region of convergence for each. Note: see Examples 13.2 and 13.3. 
Exercise 13.3 
x,(E) are functions of time: 
a(t) = ef-5P) . off) 
z(t) ee) cos(2m =) -e(L) 


: i 
gy(t) = el 2m) sin(0.5a55} -e(t) 


tl 


x,(t) will be sampled at times t = kT' to give the likewise continuous-time signal 
OO 


Lyq(t) = }_ xy[h] - 5(t — kT). 
k=O 


a) Sketch w(t) 


b) Find the Laplace transform X,,(s) of the sampled continuous-time signal 
Boalt: 


Note: Determine suitable functions x,{k] and their transforms X,(z). 


Exercise 13.4 


a) Find the z-transforms of the low-pass impulse responses x,,[k]. 


0.5 for [kl = 1 
ay (k] = 1 fork =0 
0 otherwise 


£2[k] = s Olk — yl 


pose] 


2 
wslk] = S> fk — yl 
H=0 
thy. J 8i(0.5ak) for [k| < 4 
walk] = { 0 otherwise 
b) Give the spectra F, {a,[k]} and sketch the given sequences and magnitudes 


of the spectra. 


Exercise 13.5 


Prove the following theorems of the z-transform: 


1. using the defining equation (13.1), 
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2. deriving them from the corresponding Laplace transform theorem: 
a) shift theorem 

b) modulation theorem 

c) the ‘multiplication with k’ theorer 

cl) time reversal 


Exercise 13.6 


the z-transform of x,,{k] = e?°* z[k] for Mo = 0. Xo = E and Qo = w. Sketch the 
corresponding spectra X,,(e?°). 


Let xk] = d[k ~ 1] + 26[k] + d[k + 1]. Using the modulation theorem, calculate 


Exercise 13.7 


Let X(z) be the z-transform of a right-sided discrete signal x[k| where for the 
poles of X(z), |zp,| < 0.5. Determine the z-transform of the signal and give the 
region of convergence. 

ak] = ko- alk 

walk] = alk —kol-el[k— ko] . 

aa[k] = (—e)** . z[k] 


Exercise 13.8 


Decide whether the following z-transforms belong to a finite or infinite series. Give 
the region of convergence for each under the assumption that it is a right-sided 
series being dealt with. 


IT, (z) = 2° -—1 


H2(z) = 4 ee ' 
H(z) = 5 

H(z) =1+ = ame 
Hae — ae 2 


Exercise 13.9 


Determine the inverse z-transforms of the following functions: 


ce ; 
Xi) = aR ROC: |e] > 0.5 
fe) 


ROC: {z| > 0.5. 
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Exercise 13.10 

Draw the pole-zero diagrams for 
a) Hy(z)= 22-1 
b) A(z) = 273-1 
ce) H,(2) = 2+275 


Exercise 13.11 


The pole-zero diagrams for three similar systems are shown. Calculate and sketch 
the impulse responses of the systems (to a constant factor). Where do they differ? 


system | system 2 system 3 


Im{z} 


Exercise 13.12 


1 O<k<r 
For the sequence a[k]} = ¢ ~—1 r+1<k<2r+1. reélN 
0 otherwise 


a) find the z-transform X(z) 
b) find the poles and zeros of X(z) 


c) sketch a pole-zero diagram for r = 3. 
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14 Discrete-Time LTI-Systems 


14.1 Introduction 


Now that we have described discrete-time signals in the frequency domain, we can 
deal with systems which have discrete-time input and output signals. We call these 
discrete-tume systems. They have already been briefly mentioned in Chapter 1.2.5, 
but were left in favour of continuous systems. 

The properties of discrete systems have strong parallels with continuous sys- 
tems. In fact, we can deal with them more quickly by building the corresponding 
properties to continuous systems. This is in accordance with our general goal, as 
we want to avoid technical realisations of discrete and continuous systems and deal 
only with the fundamental relationships. 


14.2 Linearity and Time-Invariance 


The most general form of a discrete system with one input and one output is 
shown in Figure 14.1. The system S processes the input. series z/k] and produces 
the output. series y[k|. The properties of the discrete system $ will be restricted 
so that it is an LTI-system. We can then fall back on Definitions 3 to 6 from 
Chapter 1, as their general formulation applies to both continuous and discrete 
systems. 


Figure 14.1: Discrete LTT-System 


Specialising the superposition principle and time-invariance to the system de- 
scribed by Figure 14.1 yields the following: 


e A discrete system S' is linear, if the superposition principle holds for the 
response to any two input signals 2, [k] and 22[(k]. 


S{Az1[k] + Bra[k}} = A S{ai[k]} + B S{xe[k}}. (14.1) 
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As in (1.3), A and B can be any complex constants. 
« A discrete system S is teme-mvariant if for the reaction y[k] to any input 
signal «[k| 
lk] = S{a(k]} (14.2) 
the relationship 
ylk -~K] = S{alk—K]}, VeeZd% (14.3) 


holds. If the index & is instead of time, a discrete position variable, for 
example, the system 5 is called shift-envarnant. In any case, the shift is only 
defined for integer values of «, as the difference k — * must give an integer 
index of the series z[k]. 


14.3 Linear Difference Equations with 
Constant Coefficients 


14.3.1 Difference Equations and Differential Equations 


As linear differential equations with constant coefficients correspond to continu- 
ous LTI-systems, linear difference equations with constant coefficients characterize 
discrete LTI-systems. Examples for such difference equations are 


yikl+ 5ulk—-] = fk (14.4) 


ulb| — sylh—1] + Sylh—-2] = afk] talk] —S0lh—-2}. (145) 


The general form of an Nth-order linear difference equation with constant. coeff- 
cients Qn, by is 


N N 
Ss any|k — n] = > b,a[k ~ nj. (14.6) 
n=O 


n==Q 


In contrast to the corresponding form (2.3) of differential equation, a shift of the 
time index k by n values occurs in place of the nth derivatives. 

For a given input signal x[k], the difference equation (14.6) has an infinite 
number of solutions y[k], that can in general be formed from N independent linear 
components, An unambiguous.solution can be obtained with N conditions, given 
by initial values instead of derivatives, for example, y(0], y[-1], y[-2|, --.. y[-N+ 
ij. 

Using the superposition principle (14.1) and the condition for time- 
invariance {14.3), it can be confirmed that a system described by the difference 
equation (14.6) is a discrete LTI-system. 
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14.3.2 Solving Linear Difference Equations 

The are two possible methods for solving the linear difference equation (14.6): 
numerical and analytical. 

14.3.2.1 Numerical Solution 


By rearranging the difference equation (14.6), we obtain the expression 


N N 
1 
yk) = — ye b,naik — nj - oS anylk — nl], (14.7) 
a0 n=) nL 
that can be numerically evaluated, beginning with k = 1,2,3,.... For k = 1, the 


calculation of the initial conditions starts with the known input signal a[k) and 
with the initial values y[0], y/—1], ..., y/-N +1]. For k > 1, the values already 
known, y[k — 1], y[k — 2], ..., are entered into the right-hand side. This method 
has practical importance, as the right side of (14.7) can be calculated quickly and 
very accurately using a digital computer. A delay by n can be implemented by 
shifting the location of the values in the memory of the computer. 


14.3.2,.2 Analytical Solution 


There is also an analytical solution which is possible in much the same way as 
with the linear differential equation. The fundamental principle is again splitting 
the solution into an external and internal part 


yik} = VYext [ki] + Ying [i . (14.8) 


Here, y{k] reperesents the solution of the difference equation under the initial 
conditions, Yex;{A] describes the response to an input signal if the system is at 
rest and yint[k] describes the homogenous solution of the initial condition problem 
without an input signal. The effect of the combined terms is shown in Figure 14.2, 
which corresponds to Figure 7.1 for continuous initial value problems. ‘The external 
and internal terms can be calculated in a similar way using the z-transform, just 
as the Laplace transform was used with continuous systems (see Chapter 7). 


14.4 Characteristic Sequences and System Func- 
tions of Discrete LTI-Systems 


14.4.1 Eigensequences 


In Chapter 13.1.1 and 13.5 we mentioned that the inverse z-transformican be inter- 
preted as superimposing eigensequences of discrete LT I-systems. Thé properties of 
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initial states 


effect 
on output 


+ Yint LK] 


discrete 
L 


x[k] system 


Figure 14.2: Combination of the external and internal terms to form the solution of a 
differential equation 


elgensequences are completely analoguous to those of eigenfunctions of continuous 
LTI-systems in accordance with Definition 10 in Chapter 3.2. An eigenseries at the 
input of a discrete LTI-system causes a response at the output that corresponds to 
the input series with a constant factor (see Figure 14.3). The proof that eigenseries 
of discrete LTI-systems are exponential series of the form e[k] = 2" will be carried 
out exactly as for the eigenfunctions in Chapter 3.2.2. We consider a general LTI- 


ef] S ~~ elk] 


Figure 14.3: System S is excited by the eigenseries c[k] 


system (Figure 14.1) and only require that it is linear (14.1) and time-invariant 
(14.2), (14.3). The input signal should be an exponential series z[k] = 2*. We 
want, to find the corresponding output signal. 


ylk] = S{z*}. (14.9) 
From the conditions of time-invariance and linearity: 
y[k — 6] = S{alk — w]} = S{2*-*} 2" S{2*} = 27% y[k]. (14.10) 


These difference equations are only fulfilled at the same time for any x, if y[A] is 
a weighted exponential series 


y[k] = Az*. (14.11) 
Equating 2[k] = 2* and y[k] = \z* yields that. every exponential series 


elk} =2*, zECc (14.12) 
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& LTl-system H(z) 24 


Figure 14.4: z* are eigenseries of discrete LTI-systems, H(z) is the eigenvalue 


is an eigenseries of an LTI-system. The corresponding eigenvalues A depend in 
general on z. As with continuous systems we call \ = H(z) the system function 
or transfer function of a discrete LTI-system (see Figure 14.4). 

Like the system function for continuous systems, the system function for dis- 
crete systems H(z) has a region of convergence which contains only part of the 
complex plane. Exciting the system with a complex exponential sequence outside 
the region of convergence does not lead to an output series with finite amplitude. 
As with continuous systems, the region of convergence of H(z) is often not explic- 
itly given. 

Finally, it should also be mentioned that a unilateral exponential series 


alk] = 2* - e[k] (14.13) 


is not an eigensequence of a discrete system. 


14.4.2 System Function 


The system function H(z) can describe the system response to all input signals 
z{k], and not just eigensequences e[k] = z*. The relationship between a general 
discrete input sequence x[k] and an exponential sequence is represented by the 
z-transform, which is given here as the inverse transform of the input signal 


a{k) = —— » X(z)2"— (14.14) 

and the output signal 
1 yp 2 . 
yk : Y¥@)2 (14.15) 


of an LTI-system. The output sequence y|k]) is obtained as the system response to 
1 ae dz 

y{k] = S{a[k]} = —- © X(z)S{2*}—. (14,16) 
2777 . z 

Inserting in S{z*} = H(z)z* (see Figure 14.4) and equating with (14.15) yields 


the relationship between the z-transforms of the input and output signals (see 
Figure 14.5) 


Y()= H(z) X(z). (14.17) 
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X(z) H(z) Y(z) = H(z) X(2) 


Figure 14.5: System function H(z) of a discrete LT Lsystem 


The system function H(z) (with its region of convergence) is a complete de- 
scription of the input-output behaviour of a discrete LTJ-system. It makes it 
possible to give the output sequence y[k] for any given input sequence z[k}. 


14.4.3 Finding System Functions from 
Difference Equations 


A system function can easily be found from a difference equation using the shift 
theorem of the z-transform (see Table 13.1). We will demonstrate the procedure 
with a few examples. 


Example 14.1 
A discrete delay circuit delays the input signal. Its ‘difference equation is 
yl[k] = a[k - 1). (14.18) 
Using the z-transform and its shift theorem (Table 13.1 ) with « = 1 yields 
Y(z) = Z{y[k]} = Z{alk — 1} = 271 X(z). (14.19) 
A comparison with (14.17) gives the system function of the discrete delay circuit 


(see Figure 14.6) 
Hie. 


xk] Ei ylk] = x[k —- 1] 
X(z) Vizjee"* Xe) 


Figure 14.6: System function of the discrete delay circuit 
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Example 14.2 


We will find the system function of a discrete LTI-system described by the 
difference equation 


1 1 1 
y|k| - 5 [k -1)+ que — 2\ = z[k} + 2[k -—1)— aulk — 2}. (14.20) 
Using the z-transform with its shift theorem 
. 1 ; 1 : 
Y(z)- 2¥ (227 + g¥ (227 = X(z)+ X(z)z7' - gi (22° : (14.21) 


From the difference equations, an algebraic equation is formed so that X(z) and 
Y(z) can be factorized 


Y(z) f - 52! + a = X(z) ! t+ 27h 5] : (14.22) 


Sorting the terms yields the system function 


¥(z) L427! - $27? e4+2—-h 
A = cod 2 = 2 : ic os 
(2) X(z) 1— ket he-2 2-324 5 ee) 


The system function of a general LTI-system of Nth-degree described by the 
difference equation (14.6) can be obtained in the same way as the last example. 
The z-transform and shift theorem yield from (14.6), 


N N 
¥VOQ)2)  aqe "SN 5) be (14.24) 


n=O m=0 


and then the system function 


(14.25) 


can be found. 

With the two examples and with (14.24) und (14.25) we can make some state- 
ments with which we are already familiar in principle from dealing with continuous 
systems and the Laplace transform: 
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e The z-transform converts a linear difference equation with constant coeffi- 
cients into an algebraic equation. The algebraic equation can be solved or 
investigated more easily than the difference equation. 


e The system function for a difference equation of finite order is a rational 
fraction function and can be described by poles and zeros. The frequency 


response of the system can be estimated easily using the methods described 
in Chapter 13.6. 


e When the system function H(z) is derived from the difference equation, its 
region of convergence can only be given if additional properties like causality 
or stability are known. For causal systems the region of convergence lies 
outside a circle about the origin, through the most distant pole. 


14.5 Block Diagrams and State-Space 


Like continuous systems, discrete systems can be represented by block diagrams. 
The parallels between the two kinds of system are particularly noticeable here as 
instead of an integrator in continuous systems, there is a delay in discrete systems. 
In the frequency-domain it means that a block with the system function H(s) = 
s~! (integrator) corresponds to a block with the system function H(z) = 27! 
(delay circuit). 


14.5.1 Direct Form I 


The direct form I of a discrete LTI-system as in Figure 14.7 corresponds exactly to 
the block diagram for continuous sytems in Figure 2.1. The only differences are the 
delay circuits in place of integrators. Comparison with the system function (14.25) 
confirms that the block diagram in Figure 14.7 realises a discrete LTT-system with 
the difference equation (14.6). 


14.5.2 Direct Form IT 


The block diagram in Figure 14.7 can be analysed as two LTI-systems connected 
in series. The order in which they are connected can be reversed (compare Fig- 
ure 2.2), but the result is the same, shown in Figure 14.8. As in Chapter 2.2, it is 
also striking that both vertical series of delays run in parallel and can be replaced 
by a single series. The result in Figure 14.9 again corresponds to the structure of 
direct form II for the continuous system shown in Figure 2.3. Direct form III (see 
Figure 2.5) can be constructed in a similiar way for discrete systems. 
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x[k] 


Figure 14.7: Direct: form | of a discrete LTI-system 


14.5.3 State-Space Description for Discrete LTI-Systems 


If a block diagram of an LT'J-system is given, a state-space representation of the 
form 


zik-+1) = Aazfk] + Balk] (14.26) 
yk) = Calk] + Dak). (14.27) 

can be formulated. 
As state vector z[k] the values stored in the delay circuits are chosen. We 
call (14.26) the system equation, which describes changes in the internal states 
depending on the current state z[k] and the input series z[k]. With the form (14.26) 


and (14.27) it is easy to characterise systems with multiple inputs and outputs 
(Figure 14.10). 


Using the z-transform on the state-space description (14.26) ,(14.27) we obtain: 
zZ(z) = AZ(z)+BX(z) (14.28) 
Y(z) = CZ(z)+DX(z). (14.29) 


These equations are identical to the state-space description of a continuous-time 
system in the Laplace-domain except that the complex variable s has in this case 
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x[k] yLK] 


Figure 14.8: Forming direct form II from direct form I 


been replaced by the complex variable z. We can therefore also use many of the 
techniques developed for continuous systems directly on discrete systems. This in- 
cludes the relationships between the difference /differential equation, block diagram 
and state-space descriptions (Chapter 2.4), equivalent state-space representations 
(Chapter 2.5) and controllability and observability (Chapter 2.6). Figure 14.10 
shows the block diagram of the state-space description for a discrete LTI-system 
with state equations (14.26), (14.27), and (14.28), (14.29). Be careful not to con- 
fuse the state vector in the time-domain z[k] with the frequency variable z of the 
z-transform! 

In the case of initial condition problems described by difference equations, the 
state-space description (14.26) and (14.27) can be extended, where the system 
is offset to a suitable time kp in a suitable initial state z[ko| so that the given 
initial conditions are fulfilled. This can be achieved using a superimposed impulse 
%6(k ~ kg|, with which the state-space description is 


a[k-+1) = Az{k] + Balk] + zod[k +1 — fol (14.30) 
y[k] = Calk] + Da[k] 


If the initial state is given at ko = +1, the c-transform of the state-space descrip- 
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Figure 14.10: Block diagram of the state-space description for a discrete LTL-system 


tion is 


i 


2Z(z) — Zo 
Y(z) 


AZ(z) + BX(z) (14.31) 
CZ(z)+DxX(z), 


{| 


which corresponds exactly to the initial value problem for continuous systems in 
the Laplace-domain (7.61), (7.62). The initial state 29 can be easily reached if 
the initial conditions are given: y[1], y[0], y[—1], -.., y[—N + 2]. Starting from 
(7.64) — (7.66), discrete initial value problems can be solved in the usual way. The 
procedure will be demonstrated with an example. 


Example 14.3 
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The second-order discrete system in Figure 14.11 is described by the following 
matrices of the state-space description: 


Kalo ene S2iesi., Ded 
1 0}? ie Cs ea ee ve 


We calculate the response of the system for z[k] = 0, and the initial values y[0| 
and y|l|, using the formula (compare (7.64) — (7.66)): 


A 
4 


¥(z) = G(z) zo, G(z) = C(zE- A)? = sme fl 2. 


i 
4 
The connection between the given initial values y[0] and y[1] and the state vector 
Zo = z[1], which causes the same output signal, can be read from Figure 14.11 


z(l]= yO], —ze[t] = 4y[1]. 


From that we obtain 


¥(2)= yy (viol + 24yi)) (14.32) 


and splitting into partial fractions 


Y(z) = ae (oto + 2uyltl) > — (viol - 2{a) | : 


Finally, the output signal is found by inverse z-transformation 


ulk] = {04 (3) : (-3) | clk ~ 1] + 
ull 5 (a) + (2) c[k 1). 


As we had taken the initial state at ky = 1, the calculated output signal also starts 
at k = 1, and delivers the expected value y[1). This can be confirmed by insertion 
into the given difference equation. 

@ 


14.6 Discrete Convolution and Impulse Response 


In Chapter 8 we introduced the impulse response as a second important charac- 
teristic for continuous systems, in addition to the system function. Its importance 
can be expressed in three significant properties: 
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x{k] ylk] 


Figure 14.11: Block diagram of the discrete system in Example 14.3 


« The impulse response of a system is its reaction to a pulse-shaped input. 


« The impulse response is obtained by inverse transforming the system func- 
tion. 


e The output signal of a system is obtained in the time-domain by convolution 
of the input signal and the impulse response. 


The derivation of these properties was not simple, as the pulse-shaped input needed 
to generate an impulse response is not an ordinary function. The price for the 
elegance of this system description was generalising functions to distributions. 
The delta impluse introduced in Chapter 8.3 cannot be characterised simply by its 
values, only by its effects on other functions, in particular, the selective property. 

This system description based on the impulse response can be transferred to 
discrete systems. We will see that for a discrete system, the impulse response 
has the same fundamental properties as for a continuous system. In one point 
the description of discrete systems becomes a lot simpler: the pulse-shaped input 
signal required to generate the impulse response is now a very simple sequence. It 
is the unit impulse introduced in Chapter12.2.1, which is a sequence of zeros and a 
single one. We can deal with these values without the use of generalised functions. 


14.6.1 Calculation of the System Response Using 
Discrete Convolution 


To introduce the impulse response of a discrete system we consider Figure 14.12. 
It shows a discrete system with input signal x[k] and output signal y[k]. The 
response A[k] to a discrete unit impulse (see Chapter 12.2.1) will be called the 
impulse response of a discrete system. 


352 14. Discrete-Time LTI-Systems 


The impulse response makes it possible to calculate the system response in 
the time-domain for discrete LTl-systems. As an example we examine the input 
sequence x[k] in Figure 14.12 with three non-zero values. We can split it into three 
individual sequences with one non-zero value in each, and then these sequences can 
be interpreted as a unit impulse shifted by « = 0,1,2. Each impulse is weighted by 
the value of the function 2k], so a[«K]é[k ~ «] for & =0,1,2. At the output of the 
LTI-system each of the shifted and weighted impulses cause a likewise shifted and 
weighted impulse response, #/K|h[k—«] for « = 0,1,2. Because the system is linear, 
the responses to the individual sequences can be added to give the response to the 
complete input signal z[k], so y{k] = 3~°_, 2[«]h[k — x]. These considerations 


MK] Mk] 
A 
ogy cle 


1 ok] = Zab Had 
0-41-23 

40] O[k] af 0] ALA] 
0123 

x1] O[k-1] x{ A] AL k-1) 
0 1 2 3 

2] df k-2 x2] Ak-2] 
PE [k-2] [2] 


Figure 14.12: Discrete convolution 


can also be extended to any input sequence a{k] with more than three values. 
The summation is performed in the general case from —oo to oo. The resulting 
expression for y{k] is the same as for convolution if the integral is replaced by a 
summation sign. We therefore refer to this as discrete convolution, which will be 
denoted with »*: 


lk) = a{kl* Ale] = So afn]alk—a] 
pearche (14.33) 
= Alkj*zik] = oy hin] a[k — «| 


The substitution n = k — « quickly shows that discrete convolution is also com- 


14.6. Discrete Convolution and Impulse Response 353 


mutative. 


14.6.2 Convolution Theorem of the z-Transform 


In the description of the system from Figure 14.12, the relationship between the 
impulse response h[k] and the system function H(z) remains undefined. To find 
it, we start with the discrete convolution in (14.33) and use the z-transform on 
both sides: 


OO CoO oxo 


Viaje. \ yieetS  eininihenle (14.34) 


k=—oc PE OO KE OO 


% 


On the right-hand side we have added in the exponent of z another zero in the 
form of & — « = 0. Interchanging the sums and rearranging terms yields 


¥(z) 2°55 caleles? So AR ale 


j 
3 
i 
8 


(14.35) 


In the second row the substitution n = k — « has been used. Both sums are inde- 
pendent of each other and represent the z-transforms of z[k] and h[k] respectively. 
From this we read: 


e Using z-transformation, discrete convolution becomes a multiplication of the 
corresponding z-transforms. 


e The z-transform of the impulse response of a discrete system is the system 
function. 


The first statement identifies the convolution theorem of the z-transform, which 
corresponds to the convolution theorem of the Laplace transform: 


(14.36) 
The region of convergence of Y(z) is at least the intersection between the ROCs 
of X(z) and H(z). That means that Y(z) definitely converges where both X(z) 
and H(z) also converge. Y(z) also converges, however, on poles of H(z) if they 
are at the same time zeros of X(<) (and vice versa). The region of convergence of 
Y(z) can therefore be greater than the intersection. 
The second statement gives the relationship between the impulse response and 
system function: 


A(z) = Z{hlkl}. (14.37) 
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As well as the system function is the impulse response a complete description 
of a discrete LT I-system’s input-output behaviour. The system response to any 
input series can be calculated using convolution with the impulse response. From 
(14.37), the region of convergence of the system function H(z) can also be found, 
which in Section 14.4 we assumed was already known. 


14.6.3 Systems with Impulse Responses of Finite and Infi- 
nite Length 

A significant distinguishing feature of discrete systems is the length of the impulse 

response. Depending on the structure of the system, it can have a finite or infinite 

number of non-zero values. We will consider two examples for discrete first-order 

systems. 


Example 14.4 


Figure 14.13 shows the structure of a system with system function 
H(z)=1+b27". 
It consists of a direct path from the input to the output and a parallel path with 
a delay and a multiplication. The response to an impulse therefore consists of two 


values and is of finite length, 


G) impulse response 


He 
; 


Figure 14.13: System with an impulse response of finite length 


A software realisation of this system in the programming language MATLAB 
could consist, for example, of the following commands: 


x =[10000 0]; % input signal: unit impulse 

b = 0.8; % multiplier 

x_old = 0; % memory (initially empty) 

y = zeros(size(x)); % output signal (not yet calculated) 


for k=1:6, % loop for 6 steps 
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y(k) = x(k) + x_old*b; % current value of the output signal 
x_old = x(k); % delaying of the input signal 
end 


The delay is formed by saving the current input value in the variable x_old. 


Example 14.5 


Figure 14.14 shows the structure of a system with system function 


EC ee 


1—az7! zZ-a 


It is made up of a direct path and a feedback loop from the output to the input 
with a delay and a multiplication. The response to an impulse decays steadily 
for 0 < jal < 1, but never quite reaches zero. ‘The impulse response is therefore 
infinitely long. 


impulse response 
Alk] 25 ie fork >0 


, QO elsewhere 


ey 
cre 


k 


Figure 14.14: System with an impulse response of infinite length 


The corresponding program steps in MATLAB are 


x =[10000 0]; % input signal: unit impulse 

a = 0.8; % multiplier 

y_old = 0; % memory (initially empty) 

y = zeros(size(x)); % output signal (not yet calculated) 

for k=1:6, % loop for 6 steps 
ylk] = x{k] + y_old*a; % current value of the output signal 
y.old = y[k]; % delaying of the output signal 

end 


Here the current output signal is saved in the variable y_old, so that the delay 
can be implemented. 
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For a = | this system represents an accumulator that sums all incoming input 
values. The impulse response of the accumulator is the discrete unit step (see 
Figure 14.14 for a = 1). We calculated the F,-transform of the discrete unit step 
in Chapter 12.3.3.3 and the corresponding z-transform in Example 13.2. 


ry 
The following terms will be used: 


e Systems with finite impulse responses are also called non-recursave or FIR- 
systems (FIR — Finite impulse Response). 


® Systems with infinite impulse response are also called recursive or HR- 
systems (IIR ~ Infinite Impulse Response). 


14.6.4 Discrete Convolution 


The great practical importance of discrete convolution comes about because the 
expression 


oO 
y[k] = 2[k] hk] = S° afk] h[k — 4] (14.38) 
R= OO 
can be implemented immediately as a computer program. In the usual program- 
ming languages, two FOR-loops are required to calculate (14.38), where the outer 
loop runs via the index & and the inner loop via the index «. There are, however, 
processors with a special architecture (digital signal processors), which can carry 
out the summation with « in (14.38) as the scalar product of two vectors very 
quickly. Even for the preparation and testing of such programs it is vital to have 
mastered discrete convolution on paper. We will therefore deal with it in even 
greater detail than the calculation of the convolution integral in Chapter 8.4.3. 
‘To begin with we show a method similar to the convolution integral in Chap- 
ter 8.4.3: 


1. Draw a[«] and h[«] with respect to x. 


2. Reverse h[x|: h{K] - h[—rl. 


oo 


Shift h[—«] by & positions to the raght: h[—K] > hik — x]. 


4. Multiplication of x[«] with h[k — «| and summation of the product for all 
values of « yields one value of yk). 


5. Repeat steps 3 and 4 for all values of k. 

Because of the commutativity of convolution, the steps can also be carried out 
if x[k] and h[k] swap places. The calculation of discrete convolution using these 
steps will be demonstrated in some examples. 
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Example 14.6 


We calculate the response of the recursive system from Figure 14.14 with the 
impulse response 
Alk] =e[kja* = O<a<l (14.39) 


to an input signal of the form 


1 for0<k<kK-1 
|] = { 0 otherwise a0) 
as a result of the convolution 
y[k] = x{k] * h[k]. (14.41) 


The impulse response A{k] and the input signal z[k] are shown in Figure 14.15. 


0 K k 


Figure 14.15: Input signal x[&] and impulse response h{k] 


By reversing and shifting the impulse response, the sequence h[k — kK] is ob- 
tained, as shown in Fig 14.16 for A = —2 and k = 6. 

For the rmaultiplication of z[«] and kik — «], and the summation with index « 
there are three cases to consider: 


e fork <0 h/k—x] and x[«] do not overlap (see Figure 14.16 bottom) and the 
product is zero for all «, so 


y{k] = 0. (14.42) 
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A{x] 
1 
° 
ie ar 
0 Kk 
A[k-x] 
k=-2 k=6 
& % 
@} 
€ e) | 
ott. ee! & 
A ae ts ane 0 2 ee 
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x[k] 
{ 
h[k-«] . # 
® 
& 
etl | 
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Figure 14.16: Mirrorred impulse response does not overlap the input signal xk] fork <0 


e ForO0 <k < K, h[k—x] and 2[k] begin to overlap, so the product z[x|h[k—«] 
for 0 <« <k is non-zero (see Figure 14.17). The summation yields 


e For Kk < k all K values of the input signal x[k] overlap with the reversed 
and shifted impulse response h[k -- «] (see Figure 14.18). It is summed over 
O<k <K and yields 


K-1 k ~K k+l(,-K 
ies pee ENS aS) a art 1) A 
y|k| = » aca ges rake: Fae (14.44) 
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overlap 


Figure 14.17: For 0 << k < K the two functions begin to overlap 


x[x] 


» | Alk-#] 


tT 


Figure 14.18: Overlap for K <k 


The sun of the values of yk] from all three component regions is represented in 
Figure 14.19. 


1 yik] 


Migure 14.19: End result for y[k] in Example 14.6 


Example 14.7 
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The convolution of a series 2[k| with a shifted and scaled unit impulse results 
in a shifted and scaled variant of z[k]: 


a|k] x Ad[k — ko] = Ax[k — ko]. (14.45) 


Figure 14.20 shows an example for A = —2 and kp = 3. 


-26[k-3] 


Figure 14.20: The given series is shifted by 3 and scaled by a factor —2 


aa mm imma ia a im iii a 
If h{k] is only a short sequence (e.g. as impulse response of a non-recursive 
filter), the steps in Figure 14.12 can be carried out to calculate the convolution 
product h[k) * a:[k]: 
1. Splitting A{A] into shifted and scaled unit impulses h[a]d[k — «i. 


2. Superimposing the component, convolution products that are given by the 
convolution of z[k] with the shifted, scaled unit impulses h[«|d[k ~ «J. 


Example 14.8 


Figure 14.22 shows the use of these steps on the input signal z[k) shown in 
Figure 14.21 and the short impulse response h[k]. Convolution of 2[k] with each 
partial sequence (left) 


= 
2 
oe 
4 
> 
le 
ms 


[k-k], w#=0,1,2 
gives the partial product (right) 
Yn{k] = h{xja[k-«], «=0,1,2 , 


whose sum over « = 0, 1,2 yields the complete output signal y[k] (bottom). 
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x{k] 
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h[k] 
Soe IE a haste s 
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Figure 14.21: Input signal c[k] and impulse response h[k] 


hol k} yolk} 
x A[k] = | | | ial 
hilk) yilk] 
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yIk} 


— 
k 
Figure 14.22: Calculating the convolution product of «[k] with the series h, (k] 


Convolution of two signals of finite duration results in another finite signal. 
From Figure 14.23 it can be taken that the first non-zero value of the result y[k] 
lies at the index which corresponds to the sum of the indices of the first values of 
xlk] and h[k]. For the last value of y[k] the equivalent is true. The duration of 
y|k] can be obtained from the durations of z|k] and h[k] with 


duration{y[k]} = duration{x[k]} + duration{h{k]} — 1. (14.46) 
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oe 7 | 0-0-0-0-6 kaitkag ke tka 


Figure 14.23: Convolution of two finite signals 2[k}] and h{kj 


14.7 Exercises 


Exercise 14.1 


Check the linearity and time-invariance of the following systems y[k] = S{z|k]}: 


f) yfki = So zl 
jo==O0 
k 
g) wkl= >> alu 
fi== CO 
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i) y{k] = ar 

Exercise 14.2 

Are the following systerns shift-invariant? Justify your answer. 
a) Downsampler by a factor of 2: y[k] = [2] 


x [$k] k even 


b) Upsampler by a factor of 2: y/k] = 
 Lpsempler Ds ull 0 ead 


c) Downsampler followed by a upsampler: 


a vn 


Investigate especially a delay by one step and by two steps. 
Exercise 14.3 
A system is given by the difference equation 
y[k] = z[k] - 2y[k — 1] — y[k — 2]. 
Determine the reaction to a) x[k] = 6[k] and b) z[k] = ek] numerically for k > —-1. 
Exercise 14.4 


Solve the following discrete initial value problem numerically for k € [0; 5): 


difference equation: —y{k] + y[k — 2] = afk] 
initial conditions: y|0| = 0 

y{L] = 5 
excitation: z[k] = (—1)*e[k] 


Exercise 14.5 


Compute numerically the output signal of the following system for k € [0;3]. Give 
Yext[k], Yin k] and the initial condition [0], if the output of the delay element has 
the initial state z[0] = 2 and x/[k] = e[k] . 
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Exercise 14.6 


a) Transform the block diagram from Exercise 14.5 into direct form I, IT and 
III. Determine for each case the initial states of the delay elements in order 
to fulfill the initial conditions. For which form is the initial state unique? 


b) Derive a difference equation from the block diagram from exercise 14.5 and 
compare the coefficients with a). 


Exercise 14.7 


Give the direct forms TI and I! for the system from Exercise 14.4. Determine the 
initial state for each so that the initial conditions are fulfilled. 


Exercise 14.8 


1 1 
A system is given by the difference equation y{k] — 3! yk — 1] + 1 —ylk — 2) = alk]. 


1\* : 
Calculate the response to [ki] = (5) e[k] with the inverse z-transform. 
Exercise 14.9 


a): Calculate the impulse response h,[k] of the discrete system 


az? 


BR re 0,8" 


|z| >. 


Are we dealing with an FIR. or an [IR system (justification)? 


b) Ay(z) will be approximated with an FIR system H2(z). The impulse re- 
sponses of hy[k] and he[k] should agree for k < 5. Find H2(z) and produce 
a block diagram realisation. 
Exercise 14.10 
‘Solve the initial value problem in Exercise 14.5 analytically using the z-transform: 
yk] — O.5yl[k — 1] = 2x[k] + 0.5a[k ~ 1] 
yl] = 3 
z[k] = e[k] 
ca) Calculate Yyoxt[k] o—-@ You (z) = H(z)» X(z). 


b) Calculate yi{k]. Start with Ying(z) = , where 2, is the pole of H(z). 


Then determine A in the time-domain ce the initial conditions. Note: see 
Chapter 7.3.3, 
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c) Give y[k]. Compare the results with Exercise 14.5. 


Exercise 14.11 


Solve the initial value problem from Exercise 14.4 analytically with the 2- 
transform. Calculate the external and internal terms as in Exercise 14.10. Verify 
the result with Exercise 14.4. 


Exercise 14.12 
Using the convolution sum (14.33), calculate c[k] = a[k] « b[k], for 
a) alk] = elk] — e[k ~ 3];  b[k] = d[k] + 26[k — 1] — d[k — 2] 
b) alk] = 0.8*e[k]; blk] = d[k + 2] 4-0.86[k + 1], with sketches. 


Exercise 14.13 
Sketch the convolution product. y[k] = 2[k] * A[k]: 


(a) x{k] ALK] 
1 1 i 
—e—e- 2-8-8 —— 8 


Exercise 14.14 


An input and output signal for a FIR system are given. Determine its impulse 
response using the idea of discrete convolution. 
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15 Causality and the Hilbert 
Transform 


Our examination of systems has so far given little thought to whether or not they 
can really be implemented. Although in some of the examples we started from an 
implementation (c.g., an electrical network), and found system descriptions like 
the impulse response or transfer function, we have not yet investigated the reverse: 
implementation of a given system function. We will correct this in this chapter 
and the next. In accordance with our stated goals at the start of the book, we 
will not be concerned with implementations using a specific technology. Instead, 
we will be looking for general criteria that have to be fulfilled for implementation 
to be possible. These criteria can be simplified into two concepts: causality and 
stability. In this chapter we will deal with questions connected to the causality of 
a system. The problem of system stability will be dealt with in the next chapter. 

Causality in general signifies a causal relationship between two or more pro- 
cesses, for example, between the input and output of a system. In the language of 
signals and systems this means more than just a logical connection (¢f input, then 
output), it also means that an event cannot happen before it has been caused by 
another (first input, then output). 

In this chapter we will be learning a simple time-domain characterisation using 
the impulse response. Its extension to the frequency-domain then leads to the idea 
of the Hilbert transform. These new tools can also be useful when the time and 
frequency-domains are exchanged. The so-called analytical signal follows from this 
use of the duality principle. 

The examination of causality is closely related for continuous and discrete-time 
systems, so we will be dealing with both kinds of system in parallel. 


15.1 Causal Systems 

We will be introducing the concept of causality in steps, beginning with systems in 
general and specialising at first into linear systems and then finally LTI systems. 
15.1.1 General Systems 


First of all we will be considering the general continuous system from Figure 15.1, 
which has no special properties that we can use. A causal relationship between the 
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input and output signal exists, if two input signals x, (¢) and «x2(t) are the same 
up to time to, then they will give rise to the same output signals y(t) and yo(t): 


ay{(t) = 24 (t) for t< ty => yi(t) = ya(t) for t<tp. (15.1) 


We could also say that if two input signals 2, (t) and x2(t) are not different up to 
a time point tp, the output signals may not differ until this time point is reached. 
As neither linearity nor time-invariance are pre-conditions, the condition (15.1) 


causal 
continuous 
system 


x(t) yO 


Figure 15.1: Definition of causality for continuous systems 


must be fulfilled for all possible pairs of input signals x,(¢) and we(t) and for all 
time points fo. 

For discrete systems, Figure 15.2 holds the corresponding condition for the 
discrete point in time ko 


«1|k| = xa[k] for k < ko => yilk] = yolk] for k< ko. (15.2) 


causal 
discrete 
system 


x) yk 


Figure 15.2: Definition of causality for discrete systems 


15.1.2 Linear Systems 


With linear systems, the difference x(t) = 21(t) — #2(t) of the input signals 
from (15.1) corresponds to the difference y(t) = y1(t) — yo(t) of the output signals. 
The condition for causality is thus more simply given by 


a(t)=0 fort < to = y(t) =O fort<to. (15.3) 


A linear system is causal if an input signal x(t) that is zero until time to causes 
an output signal y(t), that is also zero until time to. This condition must be true 
for all time points tp. The corresponding causality condition for linear discrete 
systems is simply 


alk]=0 fork<ko =>  glkl=0 fork <ko. (15.4) 
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15.1.3 LTI-Systems 


LT l-systems are time-invariant as well as being linear, and so the conditions (15.3) 
and (15.4) only need to be formulated for one point in time, for example, fo = 0 
or kp = 0, obtaining for continuous and discrete systems: 


x(t)=0 fort <0 ==> y(t) =0 fort <0 (15.5) 
glk} =0 fork <0 — ylk] =0 fork <0. (15.6) 


With help from the convolution relationships (8.39) and (14.33), 


Wires he = | AC oat de (15.7) 
y[k] = blk] *a[k] = 3 hikla[k — «] (15.8) 


we can express the conditions (15.5) and (15.6) significantly more concisely using 
the impulse response. 
For continuous systems it follows from (15.7) with x(t) = 0 for t < 0 that 


y(t) = : h( cat — cde. (15.9) 


The causality condition y(t) = 0 for t < 0 is then fulfilled when the impulse 
response h(t) disappears for t < 0: 


h(t)=0 for t<0. (15.10) 
In’ the same way, for discrete systems it follows from (15.8) that 
h[k]}=0 for k<0. (15.11) 


Figures 8.18 and 14.16 to 14.18 show calculations of convolution with the impulse 
response of causal systems (continuous and discrete). We have already learnt from 
these examples that the convolution result is non-zero only for times later than 
t. = tor + tua, where 1,1 and t,2 indicate the beginning of the signals to be 
convoluted (see Figures 8.30 and 14.23). In the case investigated here, t, = ta: = 
tag is zero. 

The condition for causality of LTI-systems can alsa be expressed concisely in 
words: 


An LTI-system is causal if its impulse response is a right-sided 
function and it disappears for negative time. 
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This statement is equally true for both continuous and discrete systems. 

From the properties of the ROC of the Laplace transform from Chapter 4.5.3 
(or the z-transform from Chapter 13.2), we can derive a general property for 
the ROC of the transfer function of a causal LTI-system. Given separately for 
continuous and discrete systems: 


e The transfer function of a continuous causal LT1-system is the Laplace trans- 
for of a right-sided function of time. It converges to the right of a vertical 
line in the complex s-plane, i.e., for Re{s} > a. 


® The transfer function of a discrete causal LTI-system is the z-transform of a 


right-sided series. It converges outside a circle in the complex z-plane, ie., 
for |z| > a. 


The transfer function of a causal LTI-system can be identified significantly 
more precisely than only by the location of the ROC. We will learn about this 
property using the spectra of causal signals in the next sections. 


15.2 Causal Signals 


15.2.1 Time-Domain 


We have already seen that the impulse response of a causal LTI-system must be 
a right-sided signal. The following investigations can be further generalised, if we 
extend them to cover all right-sided signals, irrespective of whether the signal is 
an impulse response of an LTT-system. For this reason, we have to position the 
zero point of the time axis so that the right-sided signal begins no earlier than at 
zero. Because of the close connection with causal systems, right-sided signals that 
begin no earlier than at t = 0 or k = 0 are also known as causal sagnals: 


Definition 20: Causal Signals 


Causal signals are signals that fulfill the conditions set out m (15.10) and 
(15.11), for the wmpulse responses of continuous or discrete systems, so 


x{t)=0 for t<0 and alk} =0 for k<0. (15.12) 


Example 15.1 


The signal x(t) = e(t + Le? is a right-sided signal, but is not causal. By 
shifting the zero of the time axis, we can obtain an equivalent signal u(t), that is 
causal: 

u(t) =a(t—1) =e(t)e"*". 
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15.2.2 Spectra of Causal Signals 


The causality of a signal is a property that must also be expressed in the spectrum 
of a signal. We will be investigating the characteristic properties of the spectrum 
of causal signals in the next section. The results will be general for causal signals 
and their spectra. As every causal signal can also be an impulse response for 
an LTT-system, however, these spectral properties are also valid for the frequency 
response of causal LTI-systems. 


15.2.2.1 Continuous-Time Signals 


We will start with the construction of the spectral properties of continuous-time 
signals. If a signal h(t) is causal and does not contain any Dirac impulse at ¢ = 0, 
multiplying it with a step funtion ¢(t) does not change the signal 


h(t) = h(t) -e(t). (15.13) 


Taking the Fourier transform, and using the multiplication property (9.75), to- 
gether with the spectrum of the step function (9.92), we obtain 


Jt 
2a 


AG = AG) [r5(0) + ral (15.14) 


We proceed using the selectivity property of the Delta impulse é(w) 
AGS Hy a Gee (15.15) 
J —s 9 j Qa © jw’ Lo 
and from there it follows immediately that 


1 1 


This result means first of all that the spectrum of a causal signal is not changed 
by convolution with s and division by x. In order to illustrate this better, we 
split (15.16) into real and imaginary parts: 


II 


Re{ H(jw)} “1m{H(ju)} i - (15.17) 


Im{H(jw)} 


I! 


~=Ref H1(2)} : ~ (15.18) 


As oa is purely imaginary, it is the real part of the spectrum Re{H(jw)} that 
determines the imaginary part of the convolution product and vice versa. We can 
recognise that the real and imaginary parts can be transformed into each other by 
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an operation which is identical apart from its sign. This operation is called the 
Hilbert transform, and is defined by 


| ees MR: ae eee be 
H{X(jw)} = =X (jw) +5 = — / eu) dy. (15.19) 


The Hilbert transform consists of a convolution with + and a division by 7, and 
is also an LTlL-system, although here it is defined in the frequency-domain. In 
contrast to the Laplace and Fourier transforms the Hilbert transform is not a 
transformation between the time-domain and frequency-domain, rather it assigns 
a function of variables (here frequency) to another function of the same variables, 
which is then the Hilbert transform. Calculating the Hilbert transform by evalu- 
ating the integral in (15.19) demands some care, as the denominator becomes zero 
for 7 = w. The correct procedure is shown in detail in [19, 20], for example. 


With the Hilbert transform we can concisely formulate the relationship between 
the real and imaginary parts of the spectrum of causal signals: 


Re{H(jw)} = H{Iim{A(jw)}} (15.20) 
Im{H(jw)} —-H{Re{H(jw)}}. (15.21) 


| 


I 


We can now reach the conclusion that the spectrum of a causal signal has the 
characteristic that its real and imaginary parts can be found from each other by 
the Hilbert transform (15.20, 15.21). As the impulse response of a causal system 
is a causal function, this is true for the frequency response of causal LTT-systems. 
Clearly the real and imaginary parts of the frequency response of an LTT-system, 
and likewise the magnitude and phase, cannot be given independently from each 
other. 

The result derived in this section can be easily extended to signals h(t) that 
contain a delta impulse hod(t) at the origin, which we had initially excluded. We 
replace h(t)o—eH(j = w) in (15.13) — (15.18) by h(t) — hyd(t)o—eH (gw) — ho. In 
place of (15.20) and (15.21), this yields 


a 

& 
pen 

mi 
£ 
poh 

| 


Re{ho} + H{Im{H (jw)}} (15.22) 
Im{H(jw)} = Im{ho} — H{Re{HQw)}} . (15.23) 


15.2. Causal Signals 373 


15.2.2.2 Discrete Signals 


The case for discrete causal signals is very similar to that which we have just 
examined for continuous signals. We start with a causal discrete signal h/k], that 
does not change when multiplied with the the unit step function: 


h[k}] = hlk) - e{k}. (15.24) 


The spectrum of this signal is obtained with the multiplication property (12.49) 
and the spectrum of the unit step function (12.33) 


1 1 ; ree ae: oe 
H (ei) = se ® F er a pu (3)] (15.25) 


and using the selectivity property 
1 1] 1 
JO ae Ja eee 2 EE RE nr of 
He?) = 5 tle y+ 5, le 105 ee (15.26) 


Finally it follows 


A(e3®) = =H \@— a (15.27) 


In order to find a similar ia between ( 15.17 ‘ and (15.18), we have to deal 
with the value h[0] at k = 0. Using elementary trigonometric equations we write 
1 1 1 


wee : 15.28 
lew"? 2 : 2j tan 2 ee) 


Carrying out cyclic convolution ® of H(ei°) with the coustant 5~ ~ yields the value 
h[0], so that instead of (15.27), we can use 


H(e3®) = h{0] + H(e??)®——z (15.29) 
279 tan > 
as well. Re-writing as real and imaginary parts gives 
Ref{H(e?")} = Re{h[0}} + Ime Osa (15.30) 
an 
Im{H(e)} = Im{hl0l} — Ref Me NOx aoa (15.31) 
an 


Here again are the relationships between real and imaginary parts that we can 
simplify with a suitable definition of the Hilbert transform for periodic spectra. 
This is 


Ha{X (e@)} = X(FIM)® 1 1 f"™ X(e!) 


a ee LY . 
~ Q 2-7 
Qrtany 2m J_, tan(@54) 
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The Hilbert transform H, is also a linear, time-invariant system. Thus we obtain 
the relation between the real and the imaginary part of the spectrum of a causal 
discrete signal 


Re{H(e3%)} 
Im{H(e7*")} 


i 


Re{h[0]} + H.{Im{ A (e?)}} (15.33) 
Im{h{0]} — H,{Ref{H(e)@)}}. (15.34) 


il 


These relationships are very similar to their continuous-time counterparts (15.22, 
15.23), and it is also the case that with discrete causal LTI-systems, the real and 
imaginary parts (likewise magnitude and phase of the frequency response) cannot 
be given independently from each other. 


15.3 Signals with a One-Sided Spectrum 


The properties of causal signals and their spectra can also be extended to right- 
sided spectra and their corresponding functions of time, using the duality between 
the time and frequency-domains. We thus obtain results that are closely related 
to those found in Section 15.2. Because of the duality, the time-domain and 
frequency-domain are simply interchanged. 

We start with a right-sided spectrum that contains no negative frequency com- 
ponents 


H(jw)=0 for w<0 (15.35) 


and are interested in the special properties of the time signal h(t) = F~1{H(jw)}, 
that is limited by the unilateral spectrum. First of all we establish that H(jw) 
does not exhibit conjugated symmetry (compare (9.49)). Then it follows that 
h(t)o—eH (jw) is not a real function, but in fact consists of both real and imaginary 
parts. Starting with 

H(jw) = H(jw) -€(w) (15.36) 


we can proceed in the same way as for equations (15.13) to (15.21), in order to 
obtain a dual result like (15.20), (15.21): 


Re{h(t)} 
Im{h(t)} 


—H{Im{h(t)}} (15.37) 
H{Refh(t)}} . (15.38) 


I 


I 


This result can also be extended to signals with non-zero mean having a Dirac 
impulse 27 H)6(w)e—oHp in their spectrum 
Re{h(t)}} = Re{Ho} — H{Im{h(t)}} (15.39) 
Im{h(t)} = Im{Ho} +H{Refh(t)}} (15.40) 
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For time signals, the same definition of the Hilbert transform as in (15.19) is true: 


H{2(t)} = x(t) : : : (15.41) 


Here the independent variable is in contrast to (15.19) just called ¢ and not w. 
A shorter and significantly clearer way of carrying out the Hilbert transform by 
calculating the convolution integral (15.41) can be obtained by switching to the 
frequency-domain. Using the convolution property (9.70) on (15.41) yields 


: 1 1 . 
H{x(t)} =F" {2xGu) F {rh ; (15.42) 
The transform pair (9.39) follows 


Hfx(t)} = F-4 {-jX (jw) sign w)} . (15.43) 


The Hilbert transform @(t) of a time signal x(t) is obtained if a new spectrum is 
formed from the spectrum X (jw) by inverting the sign for w < 0 and multiplying 
by —j. The function of time @(¢) corresponding to this spectrum is the Hilbert 
transform of x(t). 

This procedure is already well known, if we think of the Hilbert transform 
of a time signal as the effect of a system 7 on the input signal x(t) (Fig 15.3). 
The function 1/(t) is then the impulse response of the system + and (15.41) 
describes the convolution of the input signal a(t) with the impulse response. The 
alternative calculation in the frequency-domain is the multiplication of the input 
signal’s spectrum X(jw) with the transfer function of the system 1 


Hy(jw) = —jsign(w) . (15.44) 


This method using the frequency-domain is significantly simpler and safer to 
use than evaluating the convolution integral (15.41). Furthermore, exploiting dual- 
ity this method can also be used on (15.19) and likewise on discrete causal systems 
and unilateral periodic spectra. 

From (15.40), it can be seen that a certain real part Re {h(t)}, also defines the 
corresponding imaginary part apart from an additive constant, if the spectrum has 
no contribution for w < 0. Therefore, from a real signal x{t) a new signal 2 (t) 
can be derived by 


ay(t) = a(t) + jH{x(t)} . (15.45) 


The relations (15.39) and( 15.40) hold for its real and imaginary components. It 
therefore has a one-sided spectrum X)(jw). The mean value of the imaginary part 
has been arbitrarily set to Im{Ho} = 0; it could have been any other value. 
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1 . 
a(t) * = = &(t) 
oO °o fe; 
| i fl 
e e eS 
. Ve ls m, 
X (jw) = [-~jrsign(w)| = X(jw) 


Figure 15.3: Hilbert-transform im the time-domain and frequency-domain 


The complex signal of time a(t) is called the analytical signal corresponding 
to the real signal x(t). The analytical signal allows a simple description of impor- 
tant communications and signal processing systems like modulation, sampling of 
band-pass signals, filter banks and others. The following example shows a typical 
application. 


Example 15.2 


Figure 15.4 shows an arrangement for transmission of a real signal x(t). Its 
spectrum X(jw) has a band-pass characteristic with limit frequencies w; and we. 
In general, X(jw) is complex, but in Figure 15.4 only a real valued spectrum is 
shown, for the sake of simplicity. X(jw) has conjugate symmetry (9.49), as x(t) 
is real, and because of this symmetry, the left sideband is a reflection of the right 
and contains no further information. 

Tt is advantageous to transmit only one of the two sidebands, so that only 
half the bandwidth is needed. The missing sideband can be reconstructed. by the 
receiver as the symmetry is known. It is also useful to reduce the bandwidth if the 
signal is going to be sampled (see Chapter 11.3.2). From Table 11.2 we can see 
that a complex band-pass signal with a unilateral spectrum (shown in Figurel1.14) 
requires only half the sampling frequency that a real band-pass signal needs. It now 
remnains to be shown how a complex band-pass signal with a unilateral spectrum 
is formed from a real band-pass signal. 

This is where the Hilbert transform comes in. The signal 2; (t) (15.45) has the 
real and imaginary parts 


Re{x,(t)} = x(t), Im{a(t)} = H{a(t)} (15.46) 


and the desired right-sided spectrum X,(jw). It can be critically sampled with 
We, = we — wy, regardless of the specific values of w; and w».. The resultant signal 
x(t) has a periodic spectrum that does not overlap. The original signal x(t) can 
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XGo) 
WM @) oO 

X1(j@) 
Re{x1(0)} Im{x(0)} Toke, _ 


e/ 


Re{x2(1)} | im(x()} 


Figure 15.4: Signal transmission with the Hilbert transformator 


be obtained by filtering both of the real signals Re{xe(t)} and Im{wo(t)} using a 
complex band-pass BP, with transfer function (11.40) 


Ht ( T wymiw<we 
eo 0 otherwise 
ne ar 20 ; 
and the sampling interval T = Pane The signals s(t) and a4(t) produced are 


We 
both complex signals, and their combination 
ag(t) + jxa(t) = 21(¢) 


yields the signal «1(t), which has a one-sided spectrum. The real part Re{x,(t)} 
is the real original signal x(t), and x3(t) and x4(t) must be combined accordingly 


Re{a,(t)} = Re{x3(t) + jxa(t)} = Re{x3{t)} a Im{a,(t)} 
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for x(t) to be recovered. As the input signal of both complex band-pass filters is 
purely real, it is clear that in one branch only the real part of the impulse response 
must be considered, and in the other only the imaginary part. 

Compared to critical sampling of real valued band-pass signals (see Chap- 
ter 11.3.4), the sampling rate is reduced by a factor of two. However, consider 
that in our example, each sampling value has a real and an imaginary part, while 
in Chapter 11.3.4 all sampling values were real. The required number of real sam- 
pling values per time is thus the same. However, we may use analog-to-digital 
converters with half the sampling rate and we need not pay attention to the rela- 
tion between the band edges w, and we for critical sampling. 


15.4 Exercises 
Exercise 15.1 
Which of the following discrete systems are causal? 

a) y[k] = cia[k +1] + coa[k] 

b) lk] = afh}a[h] 

c) ylk] = alk + Va[k 

d) y[k] = sin(m - x[k]) 

e) lh} = a [2k] 
Exercise 15.2 
For wo > 0, calculate the Hilbert transform of a)e“e', b) sin wot, c) cos wot and d) 
cos 2wot in the frequency-domain. Note: see Figurel5.3. For each part, give the 
phase shift between the input and output signal caused by the Hilbert transform. 
Exercise 15.3 
Consider the real signal x(t) with spectrum X(jw). Some properties of the Hilbert 
transform y(t) = H{a(t)} = — *2(t) are to be investigated. The impulse response 
of the Hilbert transformator is indicated by A(t). 


a) Give H(jw)«—o h(t) and sketch the magnitude and phase of H(jw). How 
does the Hilbert transform affect |X(jw)| and arg{X (jw)}? 


b) Is y(t) real, imaginary or complex? What symmetry does the Hilbert trans- 
form of the even part z,(¢) and the odd part z(t) have? 
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c) Calculate the cross-correlation function of the (deterministic) signals x(t) 
and y(t) for 7 = 0, ie. pey(O) = ES x(t)y(t) dt. Which property of the 
Hilbert transform of real signals can be derived from this result? Note: see 
Chapter 9.8 and 9.9. 


d) Compute the Hilbert transform of the Fourier series 
oO 
Prod ea ee a +5 [a, cos(wovt) + by sin(wovt)], with wo > 0. 


pel 


Exercise 15.4 


Wg 1 — coswyt 


Given the signal a(t) = = and its Hilbert transform #(t) = 7{2(t)}. 


Wy 


a) Calculate and sketch X (jw) e—o x(t). 
Note: Use the multiplication theorem of the Fourier transform, Chap- 
ter 9.7.5. 


b) Determine X(jw)e—o@(t) graphically and calculate #(t). Note: consider 
Figure 15.3. 

c) Let xa (t) = x(t)+)2(t). Which special property exhibits X,(jw) e—o x,(t)? 

d) Calculate X,(jw) formally in dependence on X (jw). 


Exercise 15.5 


What is the connection between the energy of a signal a(t) and the Hilbert trans- 
formed signal #(t) = H{x(t)}? Assume that the signal has no DC component. 
Note: refer to the Parseval theorem in Chapter 9.8. 

Exercise 15.6 

Let Xi(jw) be the spectrum of the real signal a,(¢) and Xe(jw) = (1+ 
sign(w))X1(jw) the one-sided spectrum of a signal x(t). 


a) Determine x(t) in dependence on .r;(t). 
Note: Consider which transform corresponds to the required convolution, 


b) Determine the relation of the signal energies of 2, (t) und x2(t). State both 
energies directly in the frequency domain. 


c) Determine the relation of the signal energies of 2;(t) und x2(t) by a consid- 
eration in the time domain. Use the result of Exercise 15.5. 


Exercise 15.7 


A sketch of the real function P(jw) is shown, which is part of the transfer function 
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H (jw) = P(jw) + jQUjw) of a causal system. 


- 


-O g (Wg aw 


a) Doleame the corresponding impulse response h(t)o—e H{jw). Note: 
e(0) = 5 
b) Find the imaginary function Q(jw) with (15.18). 
c) What symmetry do p(t) o—e P(qw), q(t) o—e Q(jw) and Q(jw) show? 
Exercise 15.8 


An audio signal with the spectrum S(jw) is to be transmitted. In order to save 
bandwidth, the signal spectrum is 0 for |w| > w, = 2m x 4 kHz. 


| Siem 
i (jw) 


—w g Dy w 


a) The signal s(t) is modulated by cos(wot). 
s(t) Spt) 


COS pt 
Give the spectrum of sj,(t). 
b) How much bandwidth does Syz(jw) use compared to S(jw)? 


c) ‘To remove the disadvantage found in part b), the signal will be transmitted 
according to the following representation. 


COS Wot 


s(t) 


Sin (ot 


This method, known as single sideband modulation (SSB) takes advantage 
of the redundancy present in the spectrum of a real signal. Draw the 
spectrum of Spar(jw). 
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d) How much bandwidth does Sras(jw) use compared to S(jw)? 
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16 Stability and Feedback Systems 


As well as causality, another important criterion that must be met for a system to 
be implemented is stability. If a system is stable, and the input signal is bounded, 
then the output signal cannot grow beyond limit. This condition must be fulfilled, 
if continuous systems are to be realised based on the fundamental physical principle 
of conservation of energy, for example, electrical, optical, mechanical, hydraulic or 
pneumatic systems. For a discrete system the signal amplitude must stay within 
certain limits as defined by the permitted numerical range of the computer being 
used. The first thing we will do in this chapter is investigate the connections 
between stability, the frequency response and the impulse response for general LTI- 
systems. Then we will restrict ourselves to causal systems and consider stability 
tests using the pole-zero diagram. Finally we will discuss some typical uses of 
systems with feedback. We will again be dealing with continuous and discrete 
systems at the same time. 


16.1 BIBO, Impulse Response and Frequency Re- 
sponse Curve 


There are various possible ways of defining the stability of a system. Among them, 
BIBO-stability is particularly useful for LTI-systems. First of all we will introduce 
the concepts bounded function and bounded series. 


Definition 21: Bounded function, bounded series | 


A function is said to be bounded when ats magnitude rs less than a fixed limat 
for all time t: 


lx(t)| << My < 00, Vt. (16.1) 


Correspondingly, the condition 


lx[k]] < Mz < co, Vk. (16.2) 


as sufficient for a serves to be bounded. 


With these definitions we can define stability: 
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Definition 22: Stability 


A continuous-teme (discrete-tume) LTI-system 1s stable of ut reacts to a bounded 


input function x(t) (input series x{k|) unth a bounded output function y(t) | 
(output series y[k]). 


This can be neatly expressed as: 


Bounded Input —- Bounded Output. 


This stability definition is therefore called BIBO-stability. 
As with causality, stability conditions can be given for the impulse response 
of LTI-systems. From these, we can also find connections with the frequency 


response and the transfer function. We will derive this separately for continuous 
and discrete systems. 


16.1.1 Continuous LTI-Systems 


From the general definition of BIBO-stability, the following condition for the sta- 
bility of continuous LTI-systems can be derived: 


A continuous LTI-system is stable if and only if its impulse response can 
be absolutely integrated: 


ts * al) dt < Mg < 00. (16.3) 


—X) 


We will first show that this condition is sufficient for BIBO-stability. To do this 
we form the magnitude of the output signal |y(¢)| using the convolution integral. 
Taking a bounded input signal z(t) (16.1) and an impulse response h(t) that can 
be absolutely integrated, we can directly find an upper bound for |y(t)|: 


ly(t)| = Lf a(tjh(t— cde, < ir. |a(z)| |A(t — z)\dz 
- i‘ Mylh(t— alder = M, [- \A(t)|dt 


Note that the impulse response must be abolutely integratable. In order to 
show this, we consider the rather unpleasant bounded input signal 


h*(—t) 


= To 


(16.5) 
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and calculate the value 


y(0) = [. a(rjh(—c)dz = [ NG pos oh lh(c)\dr. (16.6) 


00 ~oo |A(z)| 00 


The result is only finite when the impulse response can be absolutely integrated, 
otherwise |y(¢)| would not be bounded. 
As we discovered in Chapter 9.2.2, if the impulse response can be absolutely 


the stable system — must exist. Because the Fourier integral is bounded (sec (9.5)), 
it can be analytically continued, and is the same as the Laplace transform on the 
imaginary axis s = jw. That means that for stable systems, the imaginary axis 
of the s-plane is part of the region of convergence of the system function. The 
frequency response of a stable system cannot have any singularities or discontinu- 
ities. 


16.1.2 Discrete Systems 


For discrete LTI-systems: 


A. discrete LTT-system is stable if and only if its impulse response is | 


summable: 
xO 


S> |hIk]| < Ma < oo. (16.7) 


k==—o0c 


The proof is exactly as for continuous systems. 

Tt can be shown in the same way how the existence of the frequency response as 
the Fourier transform H(e!°) = F,{h[k]} of the impulse response h[k] agrees with 
the transfer function H(z) = Z{h[k]} on the unit circle of the z-plane. Correspond- 
ingly, the frequency response of a stable system must not have any discontinuities 
or singularities. 


16.1.3. Examples 


We will clarify the use of the stability criteria (16.3) for continuous systems with 


a few examples. Stability is shown in the same way for discrete systems, using 
(16.7). 


Example 16.1 


For the simplest example we consider a system with impulse response 


h(t) = e~*e(t) ae. (16.8) 
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To determine the stability from the criteria in(16.3), we investigate whether the 
impulse response can be absolutely integrated: 


1 
100 oo — fora>od 
/ lew e(t)| dt = | edt <S (16.9) 
0 


— co otherwise 
and obtain the result: the system is stable for a > 0. 

For a = 0, the impulse response takes the form of the step function A(t) = e(t). 
We recognise the impulse response of an integrator from Chapter 8.4.4.1, and with 
(16.9) we can say the following about the system stability: an integrator is not 
BIBO-stable. This is not surprising when we recall the response of an integrator 
to a step function e(t). The integral over this bounded input signal grows with 
increasing time over all limits and thus violates the condition for BIBO-stability. 


Example 16.2 


When we dealt with the sampling theorem in Chapter 11.3.2, we used a system 
with a rectangular frequency response and a sinc function impulse response (11.35) 
as an interpolation filter for sampling. This is also called an ideal low-pass filter. 
We now want to investigate whether such a system can be realised. 

Considering the impulse response in Figure 11.11, it can be immediately seen 
that the impulse response of the ideal low-pass is a bilateral signal. The ideal 
low-pass is therefore not causal. 

As the frequency response of a stable system cannot have any discontinuities, 
we suspect that the ideal low-pass is also unstable. In order to confirm this, the 
unit of time in (11.35) is chosen so that T = x for simplification, and the impulse 
response is 


h(t) = si(t). (16.10) 


We now have to determine whether the integral 


a inca = fae Pe (16.11) 


it| it| 


has a finite value or grows beyond limit. We do this by estimating the area 
under |h(¢)| with a series of triangles whose areas are all less than the area of the 
individual sidelobes in Figure 16.1. The baselines of the triangles each have width 
7 and heights decreasing by 1/t. 'The infinite sum of these triangle area is a lower 
bound for the area under the magnitude component of the impulse response |h(t)|: 


crea | 1 Dee ee 
7: ae ee A(t)| dt. 16.12 
2u3 vk + plies. 5 fine ( 


3 
2 
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The sum itself is a known harmonic series, and does not converge, which shows 
that the impulse response of the ideal low-pass cannot be absolutely integrated. 
The ideal low-pass is therefore neither causal nor stable. 


Figure 16.1: Estimating the area under the |si|-function 


After this example we have to ask whether it is worth examining such idealised 
systems, when they are impossible to implement. The answer is typical from the 
point of view of systems theory: 


« The ideal low-pass filter with an entirely real rectangular frequency plot is 
a very simple concept. It allows many operations to be considered in the 
simplest. form, for example, limiting spectra, and reconstructing continuous 
signals from samples. 


e The ideal low-pass cannot be precisely realised but can be approximated if 
some concessions can be accepted. An example for this could be: 


— Noneritical sampling. 
Oversampling allows the steepness of the edges to be reduced (see Fig- 
ure 11.9). The impulse response then decays more quickly and therefore 
can be absolutely integrated and stable behaviour bas been achieved. 


~ Permitting a time-delay. 
The impulse response of the ideal low-pass filter can be approximated 
well by a causal system if it is shifted far enough to the right. 
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16.2 Causal Stable LTI-Systems 


LTE-systems that are causal and stable at the same time can be recognised by 
the location of their singularities in the complex s-plane. We will first give their 
properties in a general form and then specialise the result for LTT-systems with 
rational transfer functions. 


16.2.1 General Properties 
16.2.1.1 Continuous Systems 


The ROC for the transfer function of a continuous LT]-system gives us important 
information about the causality and stability of the system. We will look back at 
the ROC of the Laplace transform in Chapter 4.5.3. 

Causality means that the impulse response is a righi-sided signal. The ROC 
of the Laplace transform for right-sided signals lies to the right of a line in the 
s-plane, which is parallel to the imaginary axis. Therefore, the transfer function 
of a causal LTI-system converges in a region of the s-plane that lies to the right 
of the singularity with the greatest real part. 

Now we look again at the property of stability. It implies that it must be pos- 
sible to absolutely integrate the impulse response. We have already said that, this 
means the imaginary axis of the s-plane must be part of the region of convergence 
of the transfer function. As this must lie to the right of a border parallel to the 
imaginary axis, however, this means that the border must lie to the left of the 
imaginary axis, in the left half of the s-plane (see Figure 4.5). 

Where then, do the singularities of the transfer function lie? Since the ROC is 
free from singularities, they must lie to the left of the line, in the left half of the 
s-plane. 

We can summarise this insight with the following statement. 


All of the singularities of the transfer function A(s) for a causal, stable, 
continuous LT T-system must lie in the left half of the s-plane. 


16.2.1.2 Discrete Systems 


For discrete systems we look at the properties of the ROC of the z-transform, to 
find similar results. 

For a causal discrete LTI-system, the ROC of the transfer function H(z) lies 
outside a circle around the origin of the z-plane. Because the unit circle must be 
part of the ROC for a stable system, the radius of the border must be less than 1, 
and since the singularities cannot lie in the ROC, they must be inside this circle. 
‘Therefore: 
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All of the singularities of the system function H(z) for a causal, stable, 
discrete LTT-system must lie within the unit circle of the z-plane. 


16.2.2 LTI-Systems with Rational Transfer Functions 


The general statements can be made more precise for systems for which the transfer 
function is rational. Their singularities are simple or multiple poles that define 
the characteristic frequencies of the system. We can describe these systems with 
pole-zero diagrams. 


16.2.2.1 Continuous Systems 


For continuous LTT-systems a stability criterion follows immediately, 


The poles of the system function H(s) for a causal and stable continuous 
LT T-system lie in the left half of the s-plane. 


To. illustrate this property we must recall the internal term yin,(t) of the output 
signal from Chapter 7.3.3. It describes the part of the output signal that is caused 
by the initial state of the system. The Laplace transform of the internal term can 
be represented (see (7.92)) by partial fractions with poles s,. In the time-domain 
this corresponds to the sum of the system’s characteristic frequencies, which we 
have only written out here for N simple poles: 


N 
a A, 
Yint(s) = y, 7 
qe Se Sy 
N 
vio (t) = >— Ape*te(t). (16.13) 
wel 


For pole s, = o, + jw, the real part o, < 0 is in the left half of the plane, so the 
corresponding characteristic frequency decays 
lim e% = lie? "= 0 (16.14) 
to too 
The condition for stability, that all poles lie in the left balf of the s-plane, means 
that in the time-domain, the response to the initial conditions decays with time, 
just what we expect for a stable system. This is clear from Figure 3.3 which shows 
that only poles in the left half of the s-plane correspond to decaying exponential 
oscillations. The decay of the internal term means that the inital state of a system 
does not define the system behaviour, as long as one is prepared to wait long 
enough, 
The location of the zeros in the complex plane does not influence the charac- 
teristic frequencies and thus has no influence on the stability of the system. 


390 16. Stability and Feedback Systems 


16.2.2.2 Discrete Systems 


A corresponding result holds for discrete systems: 


The poles of the system function H(z) of a causal and stable discrete | 


LT system lie within the unit circle of the z-plane. 


Here we can also see the connection between the location of the poles in the 
complex frequency plane and the system’s characteristic frequencies in the time- 
domain (see Exercise 16.5). The stability conditions can also be illustrated to aid 
understanding, as in Figure 13.6. The internal term of the system response here 
only decays if the corresponding poles lie within the unit circle. Again, the initial 
states have no influence if one waits long enough. 


Example 16.3 


Figure 16.2 shows four pole-zero diagrams of both continuous (left) and discrete 
(right) systems. We can see immediately from the location of the poles that only 
the first and third continuous system (likewise discrete system) are stable. If, 
however, bilateral impulse responses are permitted — systems which are not causal 
~ the first three continuous systems and the first, second and fourth discrete system 
are stable. The ROC must be chosen so that it includes the imaginary axis of the 
s-plane, or the unit circle of the z-plane. When poles lie directly on the imaginary 
axis or unit circle, this becomes impossible, and the system will always be unstable, 


16.2.3 Stability Criteria 


If the transfer function of an LTJ-system in rational form is determined from a 
differential or difference equation, only the numerator and denominator coefficients 
are obtained at first. In order to check the stability with the location of the poles, 
the zeros of the denominator polynomial must be determined. This can be given 
in closed form for polynomials up to the third degree, but for higher-order systems 
iterative procedures are necessary. Once the digital computers needed to carry out 
these procedures were unavailable, but modern computers can do this easily. To 
avoid having to perform the numerical search for the zeros by hand, a series of easy 
to perform stability tests were developed. Instead of calculating the individual pole 
locations, they just determine whether all poles lie in the left half of the s-plane 
(or unit circle of the z-plane). We will only be considering one test for continuous 
and discrete systems because the tests all have essentially the same effect. 
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Figure 16.2: Pole-zero plots for stable and unstable systems 


16.2.3.1 Continuous Systems 


For continuous systems we will describe Hurwitz’s stability criteria. It does not 
involve searching for zeros, and directly uses the coefficients of the denominator 
polynomial in the transfer function. 

To use it we put the transfer function in the form 


,  P(s) 
H(s) = ——=, (16.15 
(3) O(s) ) 
so that the numerator polynomial 
Q(s) = 8% 4ays8! + ag88-? +... +ay_is + an (16.16) 


has a one as the coefficient of the highest order. 
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A polynomial is a Hurwitz polynomaalif all of its zeros have a negative real part. 
The system is stable if its numerator polynomial Q(s) is a Hurwitz polynomial, and 
Hurwitz’s stability criteria determine whether this is the case. The test consists 
of two parts: 


e A necessary condition for a Hurwitz polynomial is that all coefficients a, are 
positive: 
On > 0, R= LyasigdVs (16.17) 
It can be only be fulfilled if all orders s” in Q(s) exist, as otherwise there 
would be a coefficient a,, = 0. 
For N = 1 and N = 2 this condition is sufficient and the test is finished, but 
for N > 2 the following conditions must also be tested. 


e To formulate the necessary and sufficient condition, the Hurwitz determi- 
nants for p= 1,2,...,N are set up: 


ay 1 0 0 f) 
[aan a9 ay 1 ae 0 
An = as Ad a3 a9 as, 0 (16.18) 
Q2n—1 G2n—-2 Cyr 
with 
dy =Oforv>N. (16.19) 


Qs) is a Hurwitz polynomial if all Hurwitz determinants are positive. 


Ay > Vator = 12 (16.20) 


That concludes the Hurwitz test. We illustrate how it is carried out in Exam- 
ple 16.4. A related procedure — Routh’s stability test —- can be found in [23, 19], 


16.2.3.2 Discrete Systems 


For discrete systems, it must be determined whether all poles lie within the unit 
circle. We will therefore be using a procedure which maps the complex z-plane 
onto the complex s-plane, where we can carry out a stability test for continuous 
systems. 
The bilinear transform is a suitable way of doing this: 
st+l zt 


Go i eae (16.21) 
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It maps the inside of the unit circle |z| < 1 onto the left half-plane Re{s} < 0. We 
can show this by considering the magnitude of s = 0 + jw 


| 2,2 
(o + 1)¥ + 2 
jz] = V (o=1)F +0? ijPpor (16.22) 
For |z| < 1 follows o < 0. 
The stability of the discrete system 
Plz + 94 
H(z) = a (16.23) 


is guaranteed if the zeros of the denominator polynomial Q(z) lie in the unit circle 
of the z-plane. To check this we form the the rational function Q(s) from Q(z), 
using the bilinear transform 


O(s) = o( a (16.24) 
s~l 

Zeros of Q(s) (and so also of Q(z)) can only arise from the numerator polynomial 

of Q(s), so we test whether the numerator of Q(s) is a Hurwitz polynomial. If it 

is, the zeros must lie in the left half of the s-plane and the zeros of Q(z) must lie 

in the unit circle of the z-plane. 

The bilinear transformation (16.21) in comparison with other transformations 
that map the area within the unit circle onto the left half of the s-plane has the 
advantage that Q(s) is a rational function and we can use the Hurwitz test, for 
example. 

On closer inspection, however, our procedure is still flawed: the point z = 1 is 
projected to the point s = oo (see (16.21)), so it is not included in the Hurwitz 
test. We have to test this point Q(1) as well. 

The stability criterion for a discrete system with transfer function H(z) is now: 


Plz) 

is Q(z) 

numerator polynomial of Q(s) = Q (—) is a Hurwitz polynomial and 
‘ees 


if Q(1) #0. ; 


A discrete system with transfer function H(z) = is stable if the 


We will now demonstrate the stability test with an example. 


Example 16.4 
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Figure 16.3 shows a fourth-order recursive discrete system. In order to deter- 
mine its stability we first read from the block diagram: 


=) + X(z) (16.25) 


and from here obtain the system function 


Y¥(z) _ z a 


Hija = en ees, 
X(z) zt ~ 3238 - 322-32-4 © Q(z) 


(16.26) 


Using the bilmear transformation, the denominator Q(z) becomes the partial frac- 


tion Q(s): 


stl —1.875 (s* — 1.466789 — 3.25? — 3.86678 — 1 fy 
au =0{ 244) - Ca =) (16.27) 


We must now test the polynomial in parenthesis in the numerator of Q(s) to 
ascertain whether or not it is a Hurwitz polynomial. The necessary condition for a 
Hurwitz polynomial (16.17) is not fulfilled as not all of the coefficients are positive. 

We can now make the following deductions: 


=> Q(s) has zeros with Re{s} > 0. 
=> Q(z) has zeros with [z| > 1. 

=> H(z) has poles with |z| > 1. 

=> The system is unstable. 


Of course, the zeros of the denominator polynomial Q(z) can be found using a 
computer. The result is 


Q(z) = (z — 2) (+5) (+3) 


There is a zero at ¢ = 2 which is outside the unit circle, and this confirms the 
result we obtained using the bilinear transform and the Hurwitz test. 


16.3 Feedback Systems 


The discussion of stability so far has been limited to systems that were exclusively 
described by their transfer function. Now we will consider feedback systems that 
we are already familiar with from Chapter 6.6.3. Of course, an LT l-system with 
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x[k] 


Figure 16.3: Fourth-order recursive discrete-time system 


feedback can be described by a transfer function, as shown in Figure 6.15, but the 
information about the individual transfer functions of the forward and feedback 
paths is lost (in Figure 6.15 these are F(s) and G(s)). The feedback principle 
is used in many areas, both natural and technical. We will show three typical 
problems that can be solved using feedback. 


16.3.1 Inverting a System Using Feedback 


In Example 6.9 we saw that feedback can invert the transfer function of a system. 

Figure 16.4 shows the situation again, but in contrast to Figure 6.15, the feedback 

path contains another change of sign. The transfer function of the closed loop is 

then 

H(3)= ve) = ‘ me : 
X(s) 14+KG(s) G(s) 


for K |G(s)| > 1. (16.28) 


The poles of the whole feedback system H(s) are the zeros of G(s). They must lie 
in the left half of the s-plane, so that stability can be assured. The poles of G(s), 
however, have no influence on the stability of the feedback system. 

Continuous systems that have no zeros in the right s-plane are called minwmal 
phase systems. Correspondingly, discrete systems with no zeros outside of the 
unit circle are also called mimimal phase systems. For the inverse system aa (or 
aay) to be stable, G(s) (or G(z)) has to be minimal phase and additionally may 
not have any zeros on the imaginary axis (or on the unit circle) of the complex 
frequency plane. 
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Figure 16.4: Structure of the system G(s) with feedback loop 


16.3.2. Smoothing the Frequency Response with Feedback 


When constructing an electronic amplifier, for example, for audio use, the principle 
of negative feedback (illustrated in Figure 16.5) is very useful. An amplifier with a 


y(t) 


Figure 16.5: Smoothing the frequency response with feedback 


very high factor of amplification |f(jw)| >> 1 can be built easily, if strong variations 
in the frequency response F'(jw) can be tolerated. Some of the amplification is 
then sacrificed, by connecting the output back to the input with a gain factor K. 
The resulting frequency response 

F(jw) 


HG) = TOK RGu) © EK 


ru 


for |K-F(jw)) > 1, 


is nearly constant. It is important, of course, that |F(jw)| is large enough that the 
inequality [A - F'(jw)| >> 1 is also true for small values of K, so that the negative 
feedback system has a sufficiently high amplification 1/K. 


16.3.3 Using Feedback to Stabilise a System 


In many control system applications, the forward path (the ‘plant’) is a large tech- 
nical installation that cannot be changed by simple means. The system behaviour 
can only be modified by coupling a second system to it, usually as a backwards 
path, creating a closed feeback loop. This second system is also called the con- 
troller, and is constructed so that its properties can be changed without too much 
effort. We will now be considering whether an unstable plant. can be coupled with 
a feedback system, to yield a complete system that is stable. 
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We will start with the first-order plant from Figure 16.6. The forward path of 
the system has the first-order transfer function 


b 
H(s)=——, a>0, b>0 
8~4 
and a pole at s = a > 0 in the right half of the s-plane. It is therefore unstable. We 
choose for the feedback path, a P-circuit (shown in Figure 8.24) with amplification 


&K. The transfer function of the feedback system is 


unstable for a > 0 


¥(s) 


Figure 16.6: First-order plant with P-control 


Y(s)_s(s) | b : 
X(s) 1+KH(s) s—-a+K-b 1629) 


Q(s) = 


and it has a pole at s = a ~ Kb. The location of the pole can now be influenced 
by the amplification factor A of the P-circuit. Figure 16:7 shows the possible pole 
locations dependent on amplification K. For K = 0 the feedback has no effect 
and the pole lies at s = a. Growing values of move the pole to the left and 
when K > a/b, it is in the left half of the plane. Sufficiently large amplification 
can make the overall system stable. The path on the s-plane that the pole follows, 
dependent, of the amplification, is called the root locus. 


Figure 16.7: Root locus of the control circuit from Figure 16.6 


Feedback can also have the opposite effect: a stable plant can be destabilised 
by feedback. Here we start again with Figure 16.6, but this time choose a < 0, 
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b> OQ and K <0. The pole of the system without feedback now lies in the left 
half of the s-plane. For K < 0 it moves to the right and at K = a/b it reaches the 
right half of the plane. Figure 16.8 shows the corresponding root locus. 


Figure 16.8: Root locus of Figure 16.6 fora <0,K <0 


The influence of the P-circuit and the sign appearing at the summation node 
in the feedback path on the system as a whole can be summarised as follows: 


e Positive feedback destabilises a system. 
e Negative feedback stabilises a system. 


Unfortunately, for higher-order systems the relationships are not so simple. 
We can show this with a, second-order plant depicted in Figure 16.9. The transfer 
function in the forward path 


b aa 
has two poles at s = +,/~—a and is therefore unstable for all a. Using a P-circuit 
for feedback the overall transfer function 


OGi4 Y(s) ss A(s) b 


~ X(s) 1+KH(s) s?+a+Kb eat) 
is obtained, Figure 16.10 shows the root locus for a < 0. 

For K = 0 all of the poles of the system lie on the real axis, one in the right 
half-plane. For K < 0 nothing changes, as the poles just move further away. For 
K > 0 the poles move along the imaginary axis and for K > (—a)/b they form a 
complex conjugated pole pair on the imaginary axis. Clearly it is not possible here 
¢o move both poles into the left half of the s-plane using P-circuit feedback. This 
can be confirmed by a Hurwitz test. The denominator polynomial s? +¢+ Kd in 
(16.31) is not a Hurwitz polynomial, as the coefficient of the linear term in ¢ is 
equal to zero. 

The system can be successfully stabilised with proportional-differential feed-~ 
back as in Figure 16.11. This leads to an overall transfer function for the system 


Ene <) aC) eee ee 
X(s) 14+G(s)H(s)  s?+bKos+(a+ Kb)’ 


(16.32) 


16.3. Feedback Systems 399 


unstable for alla 


X(s) | Y(s) 


Figure 16.10: Root locus of the control circuit from Figure 16.9 


for which the denominator polynomial is a Hurwitz polynomial, if the constant K, 
and Ke are chosen so that 


bK2>0 and a+ Kk ,b>0. (16.33) 


G(s)=K +Kos 


Figure 16.11: Second-order plant with proportional-differential contro} 
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16.4 Exercises 


Exercise 16.1 


The stability of a system with impulse response h(t) = e~°* 


investigated. 


sin(57tje(t) is to be 


a) Can the impulse response be absolutely integrated? 


b) Check the location of the poles. 


Exercise 16.2 

Show that (16.7) is a necessary and sufficient condition for the BIBO-stability of 
a discrete LTI-system. 

Exercise 16.3 

A discrete LTJ-system is described by the following differential equation: 

y|k] = a[k] — a®a[k — 6] with 0 < lal < co. 


a) Determine H,(z) = so and the corresponding pole-zero diagram. Give the 


ROC of H(z). For what values of a is the system stable? 


b) Determine the transfer function H(z) of a second discrete system so that 
Hy(z) » H(z) = 1. Give both possible ROCs of H2(z) and determine for 
each whether it is stable. 


Exercise 16.4 


A system is given by the differential equation y[k] — 4y[k — 1] + ¢y|k — 2] = aA]. 


_ ¥tz 


a) Give the transfer function H(z) = eee of the system. 
b) Is the system stable? This should be determined 


a) with the pole-zero diagram, 
3) with the bilinear transformation z = pant and a stability test for con- 
tinnous systems. 


c) Is the system minimal phase? 


d) Is the system causal? 


Exercise 16.5 


Using the internal component of the output signal, give a motivation that a discrete 
system is stable if its poles lie within the unit circle of the complex z-plane (see 
Section 16.2.2), 
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Exercise 16.6 


Test the stability of the systems 


3 
se+1 
a) H(s) = SEAT TL ae) DOP TT Ba 
53 — 0.125 
b) H(s) = st — 4.583 + 83? —7s+2 
$+2 
) Hs) = aie 


without explicity finding the poles. Are the systems minimal phase? 


Exercise 16.7 
Where is the left half of the unit circle on the z-plane projected to on the s-plane 
when transformed by the bilinear transform (16.21)? 


Exercise 16.8 


2v 1 
A control loop with E(s) = s and G(s) = oes ae is given. 


Ms) 


X(s) Y(s) 


R(s) 


For the open loop the transfer function is Ho(s) = ee and for the closed loop, 
. Vs 
H(s) = wer 


a) Determine Hp(s) and H(s). 
b) Is H(s) stable? Where are the poles of H(s)? 
c) Can the system be stabilised by a suitable choice of Vo? 
d) Y= oe At what frequency w is the system unstable? 
e) Calculate r(t) for u(t) = sin(6¢) and Vo = 4 

Exercise 16,9 


Consider a system S$, with transfer function H(s) = ——~. 


a) Is H(s) stable? 
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b) S, will now be incorporated into a feedback loop, 


Give the new transfer function H,(s) = xa. 
c) For what values of K is the feedback system stable? 
d) Test the stability for K < 0 with h,(¢). 


Exercise 16.10 
A system has trausfer function H(s) = se with F(s) = —~ 


8 


—Q+5° 


¥(s) 


a) Draw the pole-zero diagram of H(s) when G(s) = 0. Is H(s) stable in this 
case? 

b) To stabilise H(s) proportional feedback is provided by G(s) (with real am- 
plification kK). Draw the root locus of H(s) for 0 < AK < oo. For what values 
of K does the stabilisation succeed? 


Exercise 16.11 
1 


s?—9s45° 


a) Draw the root locus for G(s} = K. Can the system be stabilised? 


H(s) is as in Exercise 16.10, although F(s) = 


b) If G(s) is changed to provide differential feedback with K real, can the system 
then be stabilised? If yes, for what values of K? 
Note: consider the Hurwitz test. 


17 Describing Random Signals 


17.1 Introduction 


All of the continuous and discrete signals that, we have considered so far in the 
time-domain and frequency-domain were signals that could be described by math- 
ematical functions. We could calculate the values of the signal, add and subtract 
signals, delay signals, and form derivatives and integrals. We found integration 
very useful, for convolution, for Fourier and Laplace transforms, and we also used 
complex integration for the inverse Laplace and inverse z-transforms. For discrete 
signals summation is used instead of integration. This was all possible because 
we had assumed that every signal had one definite value at every point in time, 
and that every signal could be described by a mathematical formula, however 
complicated that formula might be. 

Many signals that occur in practise do not conform to this assumption. It 
would be theoretically possible to describe the speech signal from Figure 1.1 with 
the properties of the human vocal tract by superimposing various waves, but this 
would not. lead to a technically realistic solution. It is completely impossible to 
assign functions to noise signals, or signals made up of chaotic oscillations. A new 
concept must be found to represent such irregular processes. Just understanding 
that a signal waveform can have an unpredictable value and is therefore random, 
does not actually help much. To deal with system inputs and outputs in the way we 
are used to, random signals must be described by non-random, or ‘deterministic’ 
quantities. This can be performed by the so-called expected values, which are 
introduced in the next section. Then we will deal with stationary and ergodic 
random processes, for which a significantly simpler calculation is possible with 
expected values. An important class of expected values are correlation functions, 
which will also be discussed. All of these forms for describing random signals will 
be introduced for continuous signals, and the chapter concludes by extending: the 
concepts to discrete random signals. 


17.1.1 What Are Random Signals? 


The signals that we have been working with so far are called deterministic signals, 
which means that a signal has a known unambiguous value at every point in 
time. A signal can also be deterministic when it cannot be described by simple 
mathematical functions but instead, for example, by an infinite Fourier series. 


404 17. Describing Random Signals 


Signals that have unknown behaviour are called non-determanstic signals, 
stochastic sugnals or random signals. Examples of random signals in electronics are 
interference signals like antenna noise, amplifier distortion or thermal resistance 
noise, but useful signals can also be stochastic. In communications, it is pointless 
transmitting a signal already known to the receiver. In fact, for a receiver, the less 
content of a message that can be predicted, the greater the information content in 
the message. 


17.1.2 How Can Random Signals Be Described? 


To describe random signals we can first of all try to start with the signals them- 
selves. When the signal form itself cannot be mathematically described, it can still 
be measured and a graph can be obtained, for example, in Figures 17.1 and 17.2. 
Tt is not known whether Fourier, Laplace or convolution integrals of the random 
Signals exist, or whether the methods used to calculate the spectrum or system 
function are even defined. Even when the existence of an integral is certain, the re- 
sulting spectrum or output signal is itself again a random variable whose behaviour 
we cannot make any general statements about. 

We can, for example, interpret the signal in Figure 17.1 as the noise of an 
amplifier and calculate the response of a post-connected system. The knowledge 
of this output signal, however, cannot be transferred to other situations, as another 
amplifier of the same kind would produce another noise signal, x2(t). The first 
amplifier would also never repeat the noise signal a(t), so we can do very little 
with an output signal calculated from it. 

The solution to this problem is found not by considering individual random 
signals, but instead by analysing the process that produces the signals. In our 
example it means that we should derive general statements about the noise be- 
haviour. Of course, it is impossible to know the noise signals in individual ampli- 
fiers in advance. Instead, the typical noise power can be given, for example. This 
has two significant advantages: 


« the given noise power is a deterministic property which can be calculated in 
a normal way, 


e it is the same for all amplifiers of a particular model. 


We need to introduce some new terms to extend our discussion to general random 
signals. A process that produces random signals will be called a random process. 
The entirety of all random signals that it can produce is called an ensemble of 
random signals. Individual random signals (e.g., 21 (¢}, v(t), v;(t) in Figure 17.1) 
are called sample functions or realisations of a random process. We will concentrate 
on the random process that produces the signals as only it gives information on 
all its sample functions. 
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To characterise random signals deterministically, we use statestecal averages 
also called just averages. They can be classified into characteristics of random 
processes which hold for a complete ensemble of random signals (expected value), 
and time-averages, which are found by averaging one sample function along the 
time-axis. In the next section we will deal with expected values and time-averages. 


17.2 Expected Values 


17.2.1 Expected Value and Ensemble Mean 


Several different sample functions of a process are represented in Figure 17.1. We 
can imagine that they are noise signals, that are measured at the same time on 
various ainplifiers of the same model. As expected value (also ensemble mean) we 
define the mean value that is obtained at the same time from all sample functions 
of the same process: 


‘ 
1 
E{a(ty)} = lime sp tilts) (17.1) 
ok 


As we can obtain different means at, different times, the expected value is in general 
time-dependent: 


Ex(t)} ¢ Efe(ts)}. (17.2) 


In Figure 17.1 it can be observed that the mean of the functions 
2 1(t),@2(t),---,2;(t) takes another value at time t) than at time ty. 

Since the averaging in Figure 17.1 runs in the direction of the dashed lines, the 
expected value is an average across the process. In contrast, the time-average is 
taken in the direction of the time-axis, and is an average along the process. 

The definition of the expected value in (17.1) should be understood as a for- 
mal description and not as a method for its calculation. It says that it should 
be determined from all sample functions of a process, which is in practice an im- 
possible task. The expected value identifies the whole process, not just selected 
sample functions. If we wish to actually evalute an expected value, there are three 
available methods. 


e From precise knowledge of the process the expected value can be calculated 
without averaging sample functions. We need tools from mathematical prob- 
ability, however, that we did not want as pre-requisites. 


e Averaging a finite number of sample functions can give an approximation 
of the expected value from (17.1). This is equivalent to the limit in (17.1) 
being only partially carried out. The approximation becomes more accurate 
as more sample functions are included. 
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Figure 17.1: Example of sample functions 2;(t) 


e Under certain pre-conditions, that we will deal with later in more detail, the 
ensemble average can also be expressed by the time-average for a sample 
function. 


Example 17.1 


We use the example of a die to show the three methods for finding an exact. or 
approximate expected value: 


e From knowledge of the process, which is the complete symmetry of the die, 
we can say that every number has the same probability of appearing, so the 
expected value is: 

1424+34+4+5+6 
E{x(t)} = es was. 
As the die’s symmetry does not change, the expected value is the same for 
any time f. 


« If we repeat the procedure with many dice whose symmetry properties we 
do not know precisely, we can also approximately calculate the ensemble 
average by averaging all of the numbers on the die’s faces. As the expected 
values can in general change over time, we should take the ensemble mean 
for all dice at the same time. 
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e Changing statistical properties over time is not a concern for normal dice. 
We can further say that the average for many dice at the same time will yield 
approximately the same results as one die thrown repeatedly. The numbers 
that come up are the discrete values of a sample function along the time axis. 
In this case, the expected value can also be expressed by the time-average. 


Before proceeding with the relationships between the ensemble-average and 
time-average, we will discuss some more general forms of expected values. 


17.2.2 First-Order Expected Values 


The expected value F'{x(t)} tells us what value to expect on average from a random 
process, but it does not fully characterise the process. 

Figure 17.2 shows sample functions of two random processes that have the 
same (time-variable) average, but they clearly differ in other properties. The 
sample functions of random process B vary much more around the average than 
those of process A. In order to describe such properties we introduce the general 
first-order expected value: 


N 
B{F(2(d)} = im >, Yo Flat). (17.3) 


In contrast to (17.1), x(¢) is here replaced by a function f(a(t)). By choosing 
different functions f, different first-order averages are obtained. The reason why we 
use the term first-order expected values is because they only take into account the 
amplitudes of the sample functions at one point in time. We will soon learn about 
higher-order expected values, where the values at more than one time are combined 
together. The mean according to (17.1) is contained in (17.3) for f(x) = a. It is 
also called the linear average and is denoted by E{a(t)} = pa{t). 
For f(x) = 2* we obtain the quadratic average: 


N 
E{2%(t)} = lim aw. (17.4) 
wl 


We can use it to describe the average power of a random process, for example, the 
noise power of an amplifier without load. 

The square of the deviation from the linear average is also important. It is 
obtained from (17.3) for f(x) = (2 - wz)? and is called the varzance: 


E {(x(t) - pa(t))?} = oF (t). (17.5) 
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Figure 17.2: Randorn processes A and B with a differing distribution between the indi- 
vidual sample functions 


Taking the positive square root of the variance gives the standard deviation 
o,(t). Variance and standard deviation are measures for the spread of the am- 
plitude around the linear average for a random signal. The random process A in 
Figure 17.2 clearly has a lower variance than random process B. 

The linear average and the variance are by far the most frequently used first- 
order expected values. When combined with second-order expected values they are 
sufficient to characterise many common random signals. For general random sig- 
nals it is possible to define more first-order expected values by choosing a different 
f(z) in (17.3). 


Example 17.2 


A general characterisation with first-order expected values is obtained by 
putting 
f(z) = e(O-2) 


imto (17.3) and determining the expected value dependent on the threshold ©. We 
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thus obtain the distribution function 


P,(t)() = E{e(© — a(t))}. 


It returns the probability that z(¢) is less than the threshold ©. It is depicted in 
Figure 17.3 for the die from Example 17.1. The derivative 


@’ 


Figure 17.3: Distribution function for the numbers on a die 


AP (Q) 
Sea =! P(r (®) 


is called the probability density function of the random signal x at time ¢. From 
P,()(®) or Py) (O), all first-order expected values can be calculated: 


OG 


E{f(x(2))} = | f(®)paq)(0)d0. 


me OX 


For the die from Figure 17.3, this yields a linear average ju,,(¢) = 3.5, as in Exam- 
ple 17.1. 


i 


17.2.3 Calculating with Expected Values 


Expected values can be dealt with in a similar way to functions, if the correspond- 
ing calculation rules are observed. There are actually only two simple rules to 
remember: 


e The expected value E{-} is a linear operator for which the principle of su- 
perposition holds 


| Elae(t) + by(t)} = aE{x(t)} + bE{y(t)}. | (17.6) 


Here a and 6 can also be deterministic functions of time a(t) and 6(t). 
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e The expected value of a deterministic signal d(t) is the value of the signal 
itself, as d(t) can be thought of as a realisation of a random process with 
identical sample functions: 


Ef{d(t)} = d(t). (17.7) 


Example 17.3 


We use both rules (17.6) and (17.7) to express the variance with the linear 
average and square mean: 


on7(t) = Ef{(a(t)—pe(t))?} = Efa*(t) — 2a(#)pr(t) + ue?(d)} 
= B{2(t)} — 2ye(QE{r()} + 4e2(t) 
E{x?(t)} ~ e*(t) (17.8) 


It is therefore sufficient to know only two of the three quantities -- the linear 
average, the square average and the variance — and then the third can be calculated. 
The relationship between them is often used in practice to calculate the variance. 
If N sample functions are available, x;(t) and x?(t) are summed and the result is 
divided by N. The quantity 2;(t) — uz(t) cannot be averaged because in the first 
pass, the linear average j,.(t) is not yet available. A second pass can be avoided 
by calculating the variance in accordance with (17.8). = 


17.2.4 Second-Order Expected Values 


First-order expected values hold for a certain point in time, and therefore they 
cannot register the statistical dependencies that exist. between different points in 
a signal. With second-order expected values, however, this is possible. They link 
the signal at two different points: 


B{F(e(tr),2(¢2))} = lim 7 Ne (t2)). (17.9) 


The auto-correlation function (ACF) is an important second-order expected 
value, which is obtained from (17.9) for f(u,v) = pv: 


Poa(ti, te) = E{x(ty) e(t2)}. (17.10) 


It describes the relationship between the values of a random signal at times t; 
and tg. High values for the auto-correlation function indicate that x(¢) at times ty 
and t, take similar values. For t; = tg, the auto-correlation function becomes the 
mean square 


Gre (tit) = E{a*(ti)}. (17.11) 
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Example 17.4 


Figure 17.4 shows which properties of a random signal are represented by 
second-order expected values. The random processes A and B have identical first- 
order expected values, in particular their distribution function P,q)(®) = Py)(@) 
(Example 17.2). The sample functions of random process A change much more 
slowly with time, however, than those of process B. We can therefore expect a 
much greater value of auto-correlation function ¢_2(ty,t2) for A’s neighbouring 
values ft; and ¢, than for the auto-correlation finction ¢y,(ti,t2) for B. This is 
confirmed by the measured ACFs shown in Figure 17.5. 


random process A random process B 
xy (#) r yy) 
i F 
yA 4 
\ t 
X(t) t yo(t) * 


x;(t) 


an hn Mahl 


Figure 17.4: Tllustration of two random processes A and B with identical first-order 
expected values and differing second-order expected values 


Expected values of first- and second-order are by far the most important in 
practical applications. Many descriptions of stochastic functions rely solely on 
these two. However, advanced models of complicated random processes resort 
also to higher-order expected values. This emerging branch of signal analysis is 
therefore called higher-order statistics. 


17.3 Stationary Random Processes 
In Section 17.2.1 we considered various possible methods for calculating expected 


values. One of these was expressing the ensemble mean with the time-average. 
The conditions under which this is possible will be explained in this section. 
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Py (tt) 


Pyylts ty) 


Figure 17.5: Auto-Correlation functions Qoo(t1,t2) and gyy(ti, t2) of the random pro- 
cesses A and B in Figure 17.4 


17.3.1 Definition 


A random process is called stationary if its statistical properties do not change with 
time. This appears to be the case for the two random processes in Figure 17.4, 
while in Figure 17.2, it is clear that the linear expected value changes with time. 

For a precise definition we start with a second-order expected value as in (17.9). 
If it is formed from a signal whose statistical properties do not change with time, 
then the expected value does not change if both time points ¢, and te are shifted 
by the same amount At: 


B(f(a(t1), a(t2))} = Ef f(a(t + At), (la + At))}. (17.12) 


The expected value does not depend on the individual time points t; and to, but 
instead on their difference. We can use this property to define stationary. 


Definition 23; Stationary 


- A random process 18 stationary if its second-order expected values only depend 
on the difference of observed tume points t = ty — te. 


In (17.7) we considered deterministic signals as a special case of random signals, 
for which the linear expected value is equal to the current function value. This 
means that deterministic signals can only be stationary if they are constant in 
time. Any deterministic signal that changes with time is therefore not stationary. 
The same holds for finite random signals, as a signal that is zero before or after a 
certain point in time changes its statistical properties and cannot be stationary. 
From this definition for second-order expected values we can derive the 
properties of first order expected values. As first-order expected values for 
f(x(tr), e(t2)) = g(x(t,)) are a special case of second-order expect values we find: 


E{g(x(ti))} = Ef{g(a(ta + At))}. (17.13) 
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That means that for stationary random processes, the first-order expected values 
do not depend on time. In particular, for the linear average and the variance: 


Hx (t) = Uy, Ox (t) == Se” . (17.14) 
The auto-correlation function can be expressed more simply with c= t; — ta: 
Ef{ar(t)e(t2)} = E{2(ti)e(t — 2)} = E {elle + c)a(ta)} = Gee(z). (17.15) 


The auto-correlation function gz;(c), that we introduced in (17.15) as a one- 
dimensional function is not the same function as yzs(ty,t2) in (17.10), which is a 
function of two variables, t; and t2. The two yy, are linked for stationary random 
signals (17.15). If the stationary condition only holds for 


f(w(t1), #(t2)) 
F(a(tr), e(t2)) 


however, and not for general functions f(-,-), then the random process is called 
weak statonary. Also for the linear average, the variance and the auto-correlation 
function of weak stationary processes (17.13), (17.14), and (17.15) hold. We can 
thus obtain the following statement: for a weak stationary process the linear av- 
erage and the correlation properties contained in the auto-correlation function are 
constant with time. The concept of weak stationary processes is usually used in 
the context of modelling and analysis of random procesess, where it is often a 
pre-condition. When only the linear average and auto-correlation function are 
considered, weak stationary is a less limiting condition that that of (strictly) sta- 
tionary processes for all expected values of first- and second-order. 


Hl 


x(t)) a(t2) (17.16) 
x(t), (17.17) 


i 


Example 17.5 
We take a random process with linear average E{x(t)} = 0 and the ACF 
Pox (ty, t2) = si(ty — tz). 
This random process is definitely weakly stationary, as we can write its ACF as 
Pax (t) = si(z) 


and its linear average pi. == 0 is constant. Thus (17.12) is fulfilled for the func- 
tions (17.16), (17.17). The variance of the signal is 


a. ms E{x?} = Per(O) = 1. 


With the given information we cannot tell whether or not the random process is 
stationary in the strict sense. 
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Example 17.6 


The weak stationary random signal a:(t) from Example 17.5 is modulated by a 
deterministic signal m(t) = sinw¢t, so a new random signal y(t) is created: 


y(t) = m(t)a(t) = sin(wt)x(t) . 
The linear average of y(t) in accordance with (17.6), is 
B{y(t)} = m(t) E{e(t)} = 0. 
The ACF is 
Pyy(tiste) = Ef{y(tr)y(ta)} = El{m(ty a(t )m(te)x(t2)} 
= m(t1)m(t2)Pra(ty, te). 


Pox (ty, t2) only depends on the difference between the observation times 7 = ty —ty 
(see Example 17.5), but this is not true for 


m(ty)m(ta) = sinwt, sinwt, . 


Therefore y(t) is neither stationary nor weak stationary. For example, the mean 
square at time f = 3° is 


wT T ees ae ee eee 
Pyy Coa =| = sin 5 sin 5 -si(0) = 1. 
but at time ¢ = 0, it is 


Pyy(0,0) = sin(0) sin(0 )- si(O) = = 


17.3.2 Ergodic Random Processes 


We will now return to the question of the conditions under which we can express 
the ensemble averages by the time average. We first define the first-order time 
average 


Tv 
FEM) = lim 5 =f _fleoyat (17.18) 


T-2 


and the second-order time average 


F(ai(t),a(¢-—7)) = jim oF xf. F(ay(t), a(t — z)) dt (17.19) 
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The apperently cumbersome limit T — oo is necessary because the integral 
OO 

f f()dt does not exist for a function f of a stationary random signal. The 
oO 

average is therefore formed from a section of the signal with length 27 and this 
length is then extended to infinity. 


If the time-averages (17.18), (17.19) agree for all sample functions of a random 
process and are also equal to the ensemble average, we can then express it with 
the time average of any sample function. Random processes of this kind are called 
ergodic. 


Definition 24: Ergodic | 
A stationary random process for which the time-averages of each function are 
the same as the ensemble average ts called an ergodic random process. 


It must. be proven for individual cases whether or nor a stationary random process 
is ergodic. Often this proof cannot be exactly carried out, and in these cases it can 
be assumed that the process is ergodic, as long as no indications to the contrary 
occur. The big advantage of ergodic processes is that knowledge of an individual 
sample function is sufficient to calculate expected values with the time-average. 


Similar to stationary processes, there is also a restriction for certain random 
processes. If the ergodicity conditions only hold for 


f(x(ti), w(ta)) = a(t1) x(te) (17.20) 
flx(ti),t(2)) = a(t) (17.21) 


but not for general functions f(-,-), the random process is then weak ergodic. 
Like the idea of weak stationary, it is used for modelling and analysis of random 
processes with minimal restriction. 


Example 17.7 
A random process produces sample functions 
xi(t) = sin(wot + Yi), 
where we is a fixed quantity, but the phase y; is completely random. All phase 


angles are equally likely. 


The process is stationary because the second-order expected values (17.12) only 
depend on the difference between the observation times. The ACF, for example, 
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Pealty,tg) = Ef{sin(wot +p) sin(wote + ¢)} 


20 
1 
a [snot +p) sin(wole + p)dip 
0 


1 1 
aS c08(woty ~ Wetg) = 5 COswoz mit c= ty ~ ts. 
The integral averages all phase angles between 0 and 27, 
The process is also ergodic because the time-average (17.19) agrees with the 
ensemble average. We can verify this with the example of the ACF, where 


7p 
een eres on tH 
a,(t)ei(t- 7) = lim Wr sin(wot + y;) sin(wo(t — 7) + yy)dt 


T-0o 7, 
_T 


N (w+2rp) fw 


oe Jim, ant > . sin(wot + y;) sin(wo(t — 7) + y,)dt 
p= N 
(mr+2rp)/w 


1 
= = COsuyt. 

2 
If the random process also has a random peak value @ in addition to the random 
phase y, so that 

x(t) = @sin(wot + vy), 

it is indeed stationary, but not ergodic. For example, while E{x?(¢)} = 4B {27}, 
the time-average of the square of a certain sample function ¢ is, however, r2(t) = 


Lae 


42. 
@ 


17.4 Correlation Functions 


Now that we are comfortable with expected values and have learnt ways of calcu- 
lating them, we can return to the task from Section 17.1 at the beginning of this 
chapter. We want to describe the properties of random signals with deterministic 
variables. This will now be done with first- and second-order expected values. We 
start with ergodic random processes if needed, so that the expected values can be 
expressed and evaluated with time averages. 

The most important expected values are the linear average, the auto-correlation 
function and a generalisation derived from it, the cross-correlation function. 
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For the linear expected value, in accordance with (17.1), (17.14) and (17.18) 
we obtain 


% 
ane 1 
Bistt)} = je = eG) = jim, Ta [ewe (17.22) 
-T 


As ergodic functions are stationary, the linear average js, is (like all other first 
order expected values) independent of time. From Definition 24 it is equal to the 
time average z(t). As the time average can in this case be formed from any sample 
function, the sample function in (17.22) is no longer marked by an index (compare 
(17.18)). 

We will get to know the other expected values better in the following sections, 
in particular the auto-correlation and cross-correlation functions. As we only use 
second-order expected values in the form of (17.20), weak ergodicity will be a 
sufficient. pre-requisite. 

First we consider correlation functions of purely real signals. The results will 
later be extended to complex signals. 


17.4.1 Correlation Functions of Real Signals 
17.4.1.1 Auto-Correlation Function 


We have already seen that the auto-correlation function of a weak stationary signal 
can be expressed by the time difference of the two multiplied signal values (compare 
(17.15)): 

Pralt) = E{a(t)a(t - z)}. (17.23) 


The product «2(t)a(¢— c¢) can in general take positive as well as negative values. 
Depending on which of the two predominate, the expected value is positive or 
negative. For 7 = 0, however, x?(t) is never negative and must also be greater 
than for any other value of c. That means that the auto-correlation function 
Gx2(7) has a maximum value at 7 = (0. We can show this easily, by considering 


E{ (a(t) — x(t — 2))?} = Gee(0) — Wpre(t) + Yar (0) > 0 (17.24) 
which is always positive, and which leads directly to ger(7) < Ger (0), From 
E{ (a(t) + x(t — 2))?} = Gra(0) + 26n0(T) + Pra(0) > 0 (17.25) 


we know that there is also a lower bound y.2(c) > —@1,(0). This lower bound 
can be made narrower for signals with non-zero means, by considering 


H(t) = a(t) - py (17.26) 
and the ACF 
pan(t) = E{(a(t) — pe)(a(t — 2) — He) = Gant) — 12. (17.27) 
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If we use (17.25) on weg (tc), the ACF of the signal is gz.(c) > —eze(0) + 2 = 


Yen (0) + 22. The value Yre(0) can also be expressed by the variance o2 and the 
linear mean jl, in accordance with (17.4): 


Yue (0) + 2u2 = ~02 + uo < Gre(t) < Yax(0) = 02 + 2. (17.28) 


In the relationship Ygz2(t) < Gr2(0), the equals sign represents the case where 
x(t) is a periodic function of time. If the shift by < is exactly equal to a shift 
by one period or a multiple, then x()(t + c) = x(t) and also Yy2(t) = Yex(0). 
There is no shift, however, between x(t) and a(t+ 7) for which the expected value 
becomes F'{z(t)x(t+z)} > E{x?(t)}. If such an effect is observed when measuring 
an ACI, this means that the pre-conditions for a weak stationary process are not 
there. 

A further property of the auto-correlation function is it symmetry with respect 
to ¢ = 0. As the value of yz,(z) only depends on the displacement between the 
two functions in the product x(t)x(t + 7) we can substitute (/ = t+ z and this 
yields 


E{a(t)e(t+ c)} = E{et! — ca(t’)} = Bf{a(t a(t’ -— c)}. (17.29) 


The symmetry property 
Pua z) = Pax(— r) (17.30) 


is then immediately obtained. 

For the behaviour of the auto-correlation function for ¢ — oo, no general 
statements can be made. In many cases, there is no relationship between distantly 
separated values. These values are then said to be uncorrelated. 

This property is expressed in the expected values of the signal, such that the 
second-order expected value is decomposed into the product of two first-order 
expected values: 


E {x(t)e(t — c)} = E{x(t)}- E {a(t - 2} [Z| 00, (17.31) 
As the linear expected value of a stationary signal does not depend on time, 
E{a(t)} = E{a(t—c)} = us (17.32) 
and therefore for the auto-correlation function 
Poo(t) = pe |e] + 00. (17.33) 
For signals whose values are uncorrelated if far apart, the only relationship between 
them is the (time-independent) linear average juz. 


Figure 17.6 shows a typical auto-correlation function with the properties just 
discussed: 
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| maximum value: en(0) = oF +2 > Gee(z) | (17.34) 
lower bound: Pex(t) > —o2 + p2 | (17.35) 
symmetry: Pux(t) = Sex(—r) (17.36) 
uncorrelated for |z| > co: lim Yze(c) = 2 (17.37) 

| Z|—00 


The negative values of the auto-correlation function in Figure 17.6 show that for 
these values the shift c of the expected value B{a(t + c)x(t)} is negative. It 
means that with a separation z, «(t+ 7) and a(t) are expected to have diferent 
signs. Like large positive values of the auto-correlation function, large negative 
values also indicate a strong relationship between the values of x(t). The lower 
bound —-o2 + 4.2 is not reached in this example. The first three properties (17.34) 


maximum 


atT=0 VA 


lower bound -0,? + My? 


Figure 17.6: Example of an auto-correlation function 


~ (17.36) hold for all stationary random signals 2(¢), but (17.37) only holds when 
distantly separated values do net correlate. In Example 17.7, (17.37) does not 
hold, for example. 


Example 17.8 


In Example 17.4 we considered two random processes A and B whose sam- 
ple functions clearly have statistical interdependencies. Under the assumption 
that these processes are also stationary for the section shown, we can charac- 
terise them with their auto-correlation functions yz,(z) and yyy(zc), shown in 
Figure 17.7. They are illustrated in Figure 17.7, and are found simply as cross- 
sections through Yzz(t1, tz) and Yyy(t1,t2) in Figure 17.5, along the 4, or te axis. 
The auto-correlation function yex(z) in particular is very similar to the auto- 
correlation function from Figure 17.6. In this case, however, the linear average is 
zero, which is also visible from the sample functions in Figure 17.4. The signif 
icantly faster changes in the time-behaviour of random process B in Figure 17.4 
are also expressed by a faster decay of the autocorrleation function y,,(z) from 
its maximum value in Figure 17.7. The maximum value y,,,(Q) itself is equal to 
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the corresponding value Yr~(0) of random process A, as it was already assumed 
that the first-order expected values are equal. Additionally, y(t) clearly has a zero 


mean. Both ACFs do not reach the lower limit —o} + p, = —09 + yj. 
random process A random process B 
Pl) Py 


Figure 17.7: Auto-correlation function of the random processes A and B from Figure 17.4 


Example 17.9 


Figure 17.8 shows the auto-correlation function of the speech signal for a male 
voice. The distinct negative correlation at a shift, of c ~ 5ms points towards the 
fundamental frequency. As the negative correlation occurs at a shift of one half- 
wave, this indicates a fundamental of about 100 Hz. For larger shifts, the ACF 
does not approach a constant value. In fact, vowels are periodic over a large length 
of time. For very large 7, however, we find g,.(z) = 0 because the speech signal 
has a zero mean. 
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Figure 17.8: Auto-Correlation function of a speech signal 


17.4.1.2 Auto-Covariance Function 


Introducing expected values should enable the use of deterministic functions to 
replace the random signals themselves in the system description. That means 
we could carry out the same operations that we did on deterministic input and 
output signals, the most important being the Fourier transform. If the function of 
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time can be absolutely integrated (see Chapter 9.2.2), this is sufficient condition 
for the existence of the deterministic functions. This property is not given for 
auto-correlation functions, however, if the linear average jz, is non-zero. 

In order to overcome the difficulty stated above, the linear average can be 
removed from the outset and instead of the signal a(t), the zero mean signal 
(x(t) ~ ft) can be considered. Its auto correlation function is called the auto- 
covariance function of x(t) and is denoted by z.,(7): 


Pan (t) = E{(x(t) — pa)(a(t — t) — pe) }. (17.38) 
Using the calculation rules from Section 17.2.3 we obtain 
Wen (Z) = Pen(t) — ve, (17.39) 


just as in (17.8). The properties of the auto-covariance function correspond to 
those of the auto-correlation function for zero mean signals. 


maximal value: of = tee{0) > err) (17.40) 

lower bound: (z) > —o2 = —1(0) (17.41) 

symmetry: Yre(t) = tee(-z) (17.42) 

uncorrelation for |z| — oo: ns Valet) = 0 (17.43) 
{aS 


17.4.1.3  Cross-Correlation Function 


The auto-correlation function is given by the expected value of two signal values 
that are taken from one random process at two different times. This idea can 
be extended to signal values from different random processes. The corresponding 
expected value is called the cross-correlation function. To represent its properties 
correctly we have to extend the earlier defintions of second-order expected values, 
stationary and ergodic random processes to deal with two random processes. A 
second-order joint expected value is the expected value of a function f (x(t), y(t2)). 
formed with signals from two different random processes: 


N 


EX f(a(t), y(t2))} = Jim ~ d F(willa), yi(ta)) (17.44) 


For the cross-correlation function ~.,(t1,¢2), it holds in general that (compare 
(17.10)): 


[ey (tu, te) = B (alts) -y(ta)} - | (17.45) 


The cross-correlation function is denoted like the auto-correlation function, but 
the second random process is indicated by another letter in the index. 
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Next we extend the idea of stationary from Definition 23 to cover two random 
processes. We call two random processes joint stationary, if their joint second- 
order expected values only depend on the difference ¢ = t, — tg. For joint station- 
ary random processes the cross-correlation function then takes a form similar to 
(17.15): 


Guy (t) = E {wt + c)-y(i)} = B{2(t)-y(t- 9}. (17.46) 
Finally we introduce the second-order joint time-average 


Tp 


Fea =) = jim se f flest)wle~ ade (7a) 
-T 


and call two random processes for which the joint expected values agree with 
the joint time-averages joint ergodic. There are also weak forms for joint sta- 
tionary and joint ergodic random processes, where the corresponding conditions 
are only fulfilled for f(a(1),y(te)) = ax(ti)y(te), f(r(ty),y(te)) = x(fi) and 
f(@(ta), y(t2)) = y(ta). 

The cross-correlation function performs a similar function for two random pro- 
cesses that the auto-correlation function does for one random process. It is a 
measure for the relationship of values from the two random process at two times 
separated by z. The extension to two random processes causes some differences 
to the auto-correlation function. 

First of all, two random processes can be uncorrelated not only for large time- 
spans but also for all values of z. Their cross-correlation function is then the 
product of the linear expected values zz and pty of the individual random processes: 


Galt = Bay es (17.48) 

There is also the case that two random processes are not uncorrelated for all 
values of z, but at least for |z| — oo: 

Pey( Tt) = fle by for {z| — oo. (17.49) 


Furthermore, the cross correlation function does not have the even symmetry 
of the auto-correlation function, as from (17.46) and swapping x and y, we only 
obtain 


Pay(T) = Pya(—7) # Pay(—z)- (17.50) 


The auto-correlation function gz,(c7) can be obtained from the cross- 
correlation function yz,(t) as a special case y(t) = x(t). Then using (17.50), 
we can find the symmetry property (17.36) of the auto-correlation function. 
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17.4.1.4 Cross-Covariance Function 


The cross-correlation function can also be formed for zero-mean signals (x(t) — Wz) 
and (y(t) ~ fy) and this leads to the cross-covariance function (compare Sec- 
tion 17.4.1.2): 


Pay(z) = EX (x(t) — wr) (y(t — t) — My) }- (17.51) 


As with the auto-covariance function in (17.39), the calculation rules from Sec- 
tion 17.2.3 yield the relationship between cross-covariance function %zy(c) and 
cross-correlation function gry(Z): 


Way( 7) = Poy(Z) — barby - (17.52) 


17.4.2 Correlation Functions of Complex Signals 


When we introduced the various correlation functions in Section 17.4.1 we stuck 
to real signals for the sake of simplicity. In many applications, however, complex 
signals will appear as in the signal transmission example (15.2). In this section 
we will therefore be extending the use of correlation functions to complex random 
processes. These are random processes that produce complex sample functions. 

‘To introduce the correlation functions for complex signals we proceed differ- 
ently to Section 17.4.1. There we started with the auto-correlation function and 
introduced the cross-correlation function as a generalization that contained other 
correlation functions (cross-covariance, auto-correlation, auto-covariance) as spe- 
cial cases. 

Here we start with the cross-correlation function for complex signals and derive 
the other correlation functions from it. To do this we must assume that 2(t) and 
y(t) represent complex random processes that are joint weak stationary. 


17.4.2.1 Cross-Correlation Function 


There are several possibilities for extending the cross-correlation function to cover 
complex random processes. We will choose a definition that allows a particularly 
straight forward interpretation of the crosspower spectrum. There are different 
definitions in other books (for example [19]). According to (17.46), we define the 
cross-correlation function for complex random processes as 


Gny(t) = Efa(t + 2) u'(O}- | (17.53) 


The only difference to the definition for real random processes is that the 
conjugate complex function of time y*(1) is used. For real random processes (17.53) 
becomes (17.46). 
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In general, the cross-correlation function for complex random processes is also 
neither symmetrical nor commutative: 


Pay(T) = Pya(—7) F Pyx (Tt) - (17.54) 
For uncorrelated random process we obtain 
Gey(t) = Efalt+ JHE ()} = Hey Ve. (17.55) 


17.4.2.2 Auto-Correlation Function 


The auto-correlation function of a complex random process can be obtained from 
the cross-correlation function as in (17.53), for y(t) = a(t): 


Goal) = E{a(t + 2)a*(t)}. 


(17.56) 


As in the real case, the auto-correlation function consists of a symmetry rela- 
tion at the transition from z to ~z. We can obtain it directly from (17.56) by 
substituting t’ = t+ ¢ and by using the calculation rules for conjugate complex 
quantities: 

E{o(t+ ca*()} = E{alt)a*(! -~ od} = E{[2 - d2*(’I"} 
[E {a(t — de") = gh(-2) (17.57) 


or more concisely 


il 


Pre) 


il 


The conjugate symmetry here can be recognised from (9.47), and is expressed as 
an even real part and an odd imaginary part of y.2(c). For real random processes 
the imaginary part of ¢..,(z) is zero and the even symmetry holds according to 
(17.36). In any case, the odd imaginary part disappears at ¢ = 0, so for complex 
random processes, Y,(0) is also purely real. With the same reasoning as in 
Section 17.4.1.1, it holds that the magnitude of y,.(z) is maximal at c= 0, and 
it can be expressed by the variance a2 and the mean juz: 


Poel t) $ Pae(0) = B {a(t)e"()} = 02 + pens = 02+ |e? (17.59) 


While the mean yu is in general complex for a complex random process, the 
variance is always a real quantity 


o2 = Bf (x(t) — tal f(t) ~ wel”} = B {| a(t) - we PP , (17.60) 


as the square expected value is formed in this case with the magnitude squared. 
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17.4.2.3 Cross-Covariance and Auto-Covariance Function 


From the cross-correlation function and the auto-correlation function we again 
use conversion to zero-mean siguals (a(t) ~ uw.) and (y(t) — fly) to obtain the com- 
plex cross-covariance and complex auto-covariance functions. The cross-covariance 
function is given by 


Way (t) = E{(a(t + 7) — pa)(y(t) — Hy)"} « (17.61) 


where the relationship 
iy si * 17 66 
Yay (T) = Pay(T) — placfty (17.62) 
with the cross-correlation function bolds. The cross-covariance function is also 
neither symmetrical nor commutative: 


Puy (Tt) = Wye (-z)# Pye ( t). (17.63) 


If both random processes are not correlated for large timespans zc, the cross- 
covariance function approaches zero for |z| - oo: 
¥ 


bey(t) =O Pur |e|—-oo. (17.64) 


The auto-covariance function 4,.,.(z7) comes from the cross-covariance function 
Way(t) where y(t) = a(t). Its relationship with the auto-correlation function is: 


then) = Gaol t) — He He = Poe (t) ~ |pol? (17.65) 
with the conjugate syimmetry 
Poo(t) = Whe(—2). (17.66) 
The maximum value at c = 0 is equal to the variance o?: 
Yee 0) = 02", (17.67) 


The auto-covariance function also disappears for |z| > 00 if the random process 
no longer correlates when z is large: 


Welt) =O for |z]—- oo. (17.68) 


17.5 Power Density Spectra 


Describing random signals with expected values and in particular with correlation 
functions showed that the properties of random signals can be expressed by deter- 
ministic qunatities. Instead of a random time signal there would be, for example, 
the deterministic auto-correlation function which is likewise a deterministic quan- 
tity. In the past chapters we saw that describing signals in the frequency-domain is 
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particularly useful, and often leads to elegant methods for analysing LTT-systems. 
We would therefore like to have a deterministic description of random signals in 
the frequency-domain as well. 

The idea that first comes to mind is describing sample functions 2;(¢) of a ran- 
dom process as expected values instead of considering them as random signals, but 
this idea is actually unsuitable. Stationary random signals can never be integrated 
absolutely (9.4), as they do not decay for |t} + oo. Therefore the Laplace integral 
cannot exist and the Fourier transform can only exist in special cases. Instead 
of transforming into the frequency-domain and then forming expected values, we 
form the expected values in the time-domain and then transfer the deterministic 
quantities to the frequency-domain. This idea is the basis for the definition of the 
power density spectrum. 


17.5.1 Definition 


We start with the auto-correlation function or the auto-covariance function of a 
weak stationary random process and form its Fourier transform: 


[ Pox 9) = F fren 2)} | (17.69) 


Tt is also called the power density spectrum of the random process. The power 
density spectrum characterises statistical dependencies of the signal amplitude at 
two different points in time. Correspondingly, the Fourier transform of a cross- 
correlation function can be formed giving the cross-power density spectrum: 


| oy CGw) = Fivayl @)} | (17.70) 


®..,.(jw) is also called the cross-spectrum. 
¥ 


Example 17.10 


In Example 17.7 we examined a stationary random process which produced 
sinusoidal sample functions 2;(£) = sin(wot-+y,;) with random phase y;. For these 
sample functions it is sometimes even possible to give the Fourier transform 


X; (jw) = [5 (wv ~ wip) ~ m5 (w+ wp)Jere/or 


Its linear average 
E{X(ju)} = 0 


does not say much, however, and the mean square 


E{Xi(gw) XP (jw) } 
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cannot be given because of the delta impulse. In the best case we can form 
E{|X;(jw)|} = 7d(w ~ wo) + 1d(w + wo) 


as a deterministic description of the random process. Forming the expected values 
first in the time-domain and then transforming them yields the power density 
spectrum 


: T. w 1 
©... (jw) = 5 lw = wo) + Zo ze ul) 0 Pax(t) = 5 COB Wo & 


as the Fourier transform of the ACF. It is similar to E{|X;(jw)|} and likewise 
indicates that the random signal only contains frequency components at -kw. 


17.5.2 Power Density Spectrum and Mean Square 


The mean square of a random process can also be calculated directly from the 
power density spectrum. First, the auto-correlation function is expressed as the 
inverse Fourier transform of the power density spectrum: 


es : me fae ee 
Pua(Z) = F 1fO,»(jw)} = = | Poo (jw er? = du. (17.71) 
OX) 
As the mean square is equal to the value of the auto-correlation fumction at 


z = 0, we can obtain the relationship between the power density spectrum and 
mean square by putting ¢ = 0 into (17.71): 


(17.72) 


The mean square is therefore equal to the integral of the power density spec- 
trum, multiplied by a factor 1/27. 


area is equal to the 
mean square of the 
signal ("power") 


Figure 17.9: The area under the power density spectrum ®z2(ju) of a signal x(t) is 
proportional to the mean square of the signal 
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We saw by introducing the mean square into (L7.4) that it can also be used 
aS a measure of the power of a random process, for example, as noise power of 
random interference. Relation (17.72) suggests the interpretation that the power 
density spectrum describes the power distribution over various frequencies for a 
random process. We will return to this idea in Chapter 18.2.6 where it, will be 
refined and made more precise. 


17.5.3 Symmetry Properties of the Power Density Spec- 
trum 


The symmetry properties of the power density spectrum come directly from the 
conjugate symmetry of the auto-correlation function (17.58). As the real part of 
the auto-correlation function is an even function, we know from the symmetry 
properties of the Fourier transform (9.61) that the power density spectrum must 
be purely real: 

Im{Op.(jw)} = 0. (17.73) 
It also holds if x(t) describes a random processs. In Chapter 18.2.6 we will show 
that 

Pen (jw) 20 

holds in the general case. 


The cross-power density spectrum and the cross-correlation function show no 
particularly interesting symmetries, just 


Sy (jw) = 1, (3) (17.74) 


from (17.54). 
For real random processes a farther symmetry property can be obtained, how- 
ever. The auto-correlation function is then a real and even function 


Yaua(Z) ae Pra (— zt}, (17.75) 


in accordance with (17.30). Its Fourier transform (9.61) is likewise real and even, 
and the power density spectrum of a real random process is therefore an even 
function: 

Py. (jw) = Pre (—jw) . (17.76) 


For the cross-power density spectrum of two real random processes we obtain the 
conjugate symmetry 


Pry(jw) = O27, (—jw) = Pya(—jw) = Of, (jw) (17.77) 


from (17.74) and (9.61). As the cross-correlation function is in general not sym- 
metrical, the cross-power density spectrum of a real random process is also not 
real. Just like the CCF, the cross-power density spectrum is not commutative. 
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Example 17.11 


As an example we will consider the power density spectrum in Figure 17.10 
for the speech signal from Example 17.9. As expected, it is real and positive, and 
as the speech signal is, of course, itself real-valued, the power density spectrum 
is also an even function. In Figure 17.10 therefore, only the positive frequencies 
are shown. The concentration of power density in the 100 Hz region is clearly 
recogniseable. This result agrees with the rough estimation of the fundamental 
speech frequency in Example 17.9. 


| i | 


_A er pr, 3 
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Figure 17.10: Power density spectrum of the speech signal from Figure 17.10 


17.5.4 White Noise 


Many interference sources, like amplifier noise or radio interference, can be de- 
scribed by random processes with a power density spectrum that is almost constant 
over a large range of frequencies. Such random processes are often approximated 
by an idealised process, whose power density spectrum is not frequency dependent: 


Pan (jw) = No P (17.78) 


Since all frequencies occur evenly, the idealised process is called white nowe. The 
name is derived from the term ‘white light’, which represents a uniform mixture 
of every colour in the spectrum. 

The auto-correlation function of white noise can only be represented by a dis- 
tribution, the delta impulse: 


gnn(2) = F-!{No} = Nod(z). (17.79) 


This means that samples of white noise taken at different times do not correlate. 
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From the representation of white noise in the time-domain (17.79) and in the 
frequency-domain (17.78), we see that a white noise signal must have infinite 
power: 


OO 
, den fre 
Yrn(O) = a | Ng dw oo. (17.80) 
w 
oo 
White noise is therefore an idealisation that cannot actually be realised. De- 
spite this, it has extremely simple forms of power density spectrum and auto- 
correlation function that are very useful, and the idealisation can be justified if 
the white noise signal is high- or low-pass filtered, and the highest frequency com- 
ponents suppressed. This leads to a refined model for random processes: band- 
limited white noise with a rectangular power density spectrum 
; No for |w| < wmax 
Oy,(jw) = s (17.81) 


0 otherwise 


with a si-shaped auto-correlation function 


2Wmax WT 


Ynn(t) =F 1s vt ) \ = No =e si(ZWmax) (17.82) 


and finite power 


nn (0) a No ~aee ‘ (17.83) 


It characterises noise processes whose power is evenly distributed below a band 
limit wax. Figure 17.11 shows the power density spectrum and the auto- 
correlation function. 


D,,,(j@) PnyfT) 
An . 
fj No © max 
cd é 
Wax ran 


Figure 17.11: Band-limited white noise in the frequency-domain and time-domain 


17.6 Describing Discrete Random Signals 


The concepts discussed so far for continuous random signals can easily be extended 
to random sequences. As most of the reasoning and derivation is very similar, 
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we will forego examining them in detail. However, we need to be aware of the 
definitions of stationary and ergodicity as they apply to random sequences. 
Stationary means in this case that the second-order expected values 
E{f(alki],y[k2|)} only depend on integer differences x = ky ~ kp between the 
discrete time variables k, and ke. 
The time-average, necessary for the definition of ergodicity, is given for sample 
sequences of a discrete random process by 


pitta 1 


K 
Flee) = Jim seq De, f(ailk)). (17.84) 


From here, the auto-correlation, cross-correlation and covariances can be con- 
sidered in the same way as for continuous random processes, Instead of auto- 
correlation and cross-correlation functions, we will be using auto-correlation and 
cross-correlation sequences. 

For the cross-power density spectrum of two discrete weak stationary random 
processes, we obtain from the discrete-time Fourier transform the spectrum 


Bey (EF) = F.{yoylK]}, (17.85) 


periodic in 2. The power density spectrum of a discrete random process corre- 
sponds to the case where y = 2. 


Example 17.12 


A weak stationary continuous random process Z(t) is characterised by an ex- 
ponentially decaying ACF 


Samples are taken at intervals T 
alk] =a(kT) kEZ. 
‘The auto-correlation sequence is 
Yor |k] = E{alk + wja[k]} = E{R(kT + «T)E(kT)} = vax (aT) = ew voll | 
The power density spectrum of the discrete random process is 


: err 2a9T 


~ [+ e72weT — Qe-eT cos D) 


Ba» (e?) eae) ae {Pax [«]} 


and is shown in Figure 17.12. It is positive, real and even, like the power density 
spectrum of a continuous random process with real values. In addition, it is 27 
periodic. As the auto-correlation sequences Y,,[K] is yielded simply by sampling 
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Figure 17.12: Power density spectrum of the discrete random process Yaz 


the auto-correlation sequences yzz(t), the power density spectrum of the discrete 
random process 2 2(e7%) is simply the periodic continuation of the power density 
spectrum ®;;(jw), in accordance with (11.33) 


1 §Q Q 
BOY os OE | Ng cae a 
®,,..(e7") ay Pas ( i ) * LIL (=) 


17.7 Exercises 


Exercise 17.1 


For which of the following ensembles might hold: 


T 
a) Jim FM (t) = jim a Ff x,(t) dt, for any 7 


lim Fe (a Jima ak @,*(t) dt, for any ¢ 


ee 
Start by veri formulating the conditions. 


Ensemble 1 Ensemble 2 


x) 
aa 
Xq(t) , 
ft 
x3(t) i | ; 
\ : 


x4@) 


17.7. Exercises 433 


| Ensemble 3 a 4 Ensemble 4 
X4(f) x 
Twin eget 
t : 
X(t) X4() rl Ln f 
ane blll 
x 3(t) aa) . 
ce = 


Ensemble 5: from Figure 17.1 


Exercise 17.2 


Discuss which of the ensembles from Exercise 17.1 could be: 
a) weak stationary, 
b) weak ergodic. 


Exercise 17.3 


Consider a random process x(t) at the output of a CD-player where the sample 
functions are produced by someone continually repeating a ten second section from 
a rock CD. Assume that it is the ideal case in which this has been happening for 
an infinite time and the CD-player will go on playing infinitely. 


a) How large are E{a(t)} and «;(t) under the assumption that the output has 
no DC component? 


b) Using the first-order expected values, discuss whether the process could be 
stationary. 


c) Using the first-order expected values, discuss whether the process could be 
ergodic. 
Exercise 17.4 


Take two uncorrelated random processes #1 (t) and ao(t), where jz, = 2, ps, = 0, 
E{x7(t)} = 5 and E{a3(t)} = 2. Calculate the averages y(t), 02(t), E{y*(t)} for 
the random process y(t) = 2,(t) + x(t). 


Exercise 17.5 


Find the variance of u(t) = x(t)+y(#), where x(t) is a random signal with variance 
o2 = 10 and y(t) is any deterministic signal. 


Exercise 17.6 


The ergodic random process x(t) has fig = 1 and o% = 4. Calculate y(t), o3(t), 
E{y?(t)} and yi(t) for 
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a) y(t) = z(t) +K 

b) y(t) = x(t) +sint 
c) y(t) = w(t) + e(t) 
d) y(t) = a(t) 5e(2) 


For each part, say whether y(t) is ergodic. Assume in part d) that all sample 
functions x;(t) are even, 


Exercise 17.7 
Give z(t), B{x?(t)}, 02(£) and 2;(é) for the deterministic signal x(t) = e~°"e(t), 


Exercise 17.8 


vonsider the discrete random process ‘throwing a die’, where a) x[k] is the number 
thrown and b) a[k] is the square of the number thrown. Find jiz[k], 72[k] and 
E{x?|k|}. Are the processes ergodic? 

Exercise 17.9 


Consider the discrete random process ‘throwing a loaded die’ where six always 
appears at times k = 3N,N € Z, but the numbers thrown at other times are 
distributed equally, and where y/k] is the number thrown. Find ys[k] and y yi lk}, 
and also py{k], oy[k] and E{y*[k]}. Is the process stationary and/or ergodic? 


Exercise 17.10 
Calculate the ACF of deterministic signal x(t) = K, K €€ with (17.56). 


Exercise 17.11 


What peculiarities does the ACF have for the random process from Exercise 17,3? 
Does it only depend on the difference of the averaging points? Give gea(to.to + 
10s). 


Exercise 17.12 
Let x(t) and y(t) be two real random signals. 
a) Show that E{a(t)y(t)} = 0 entails from E{(2(t) + y(t))?} = B{27(t)} + 
E{y?(t)} 
b) How can F{x(t}y(4)} be simplified if 2(t) and y(t) are uncorrelated? 
c) Give the conditions for uncorrelated x(t) and y(t) so that E{a(t)y(t)} = 0 
Exercise 17.13 


What are the formulae for power, DC component, effective value and AC power 
for a deterministic real signal d(t)? 
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Exercise 17.14 


The AC component power of a deterministic real signal d(t) with DC component 
scan be calculated in two ways: P = (d(t) — 4)? or P = d2(t) — y?. Show that 
both formulae produce the same result. 


Exercise 17.15 


Derive the equation ¢zy(7) = Yxy(z) — rey which holds for all real stationary 
random processes. Start with the definition (17.51). 


Exercise 17.16 


The relationship between two stationary random processes x(t) and y(t) is ex- 


Ac? +10 


pressed by Yay(t) = <Ee Find jy, Pye(t), Pay(t) and Wye(z), if pe = 1. 


Exercise 17.17 
A stationary random process v(t} with y,,(t) = e!7l is used to create a further 
random process u(t) by delaying v(t) by tp = 10. Determine 

a) Hay Hus Puu(Z); Puu( 7) and Puul TZ) 

b) Pyy (jw), Puy(jw) and Oy. (jw). 


c) What symmetry properties do ®,,(jw), By.(gw) and ©,,,(gw) have? Is the 
random process complex? 


Exercise 17.18 


Determine the auto-correlation sequence Yza[«], the auto-covariance sequence 
ee [K] and the power density spectrum ®,,(e)@) of the random process from 
Exercise 17.8a). 


Exercise 17.19 


Consider the ergodic discrete random process ‘throwing a tetrahedral die’, which 
has 0 marked on one side and 1 marked on the other three, [kl is the number 
lying underneath. Determine jz, 2", Prr[K], Yea[s] and ®,,(e%). 


Exercise 17.20 


The ensemble x/k| is produced as in Exercise 17.19, and a further ensemble is pro- 
duced by throwing a second tetrahedron whose sides are marked with the numbers 
1,2,3 and 4; y|k] is the number lying underneath. Determine py, Ty?, Pyy[A], PaylAl 
~ ro. 

and Pya|K). 


436 17. Describing Random Signals 


Exercise 17.21 


The sketched power density spectrum of a random process x(t) is given. Determine 
the power and auto-correlation function of x(¢). 


18 Random Signals and 
LTI-Systems 


Now that we have described random signals with correlation functions and power 
density spectra, we can use these new tools to investigate the response of LTI- 
systems to random signals. Rather than being interested in the precise behaviour 
of the output signal when a particular sample function of a random process appears 
at the input, we want to describe the system output as a random process and are 
looking for the expected values of the output process dependent on the expected 
values of the input process. 

We will see that the relationships between the expected values at the input 
and output of an LTI-system take a similar form to the relationships between 
deterministic input and output signals. 

To begin the chapter we will deal with random signals that are the result of 
multiplying a random signal with a constant or by adding random signals together. 
Then we will describe the response of LTI-systerns to random signals. Finally we 
will consider applications of the theory. 


18.1 Combining Random Signals 


With expected values, correlation functions and power density spectra, we have 
learnt the most significant forms for describing random signals in the time-domain 
and frequency-domain. Now we are interested in the connections between random 
signals and what influence they have on the description forms just mentioned. The 
discussion will be restricted to multiplication of a random signal with a constant 
aud adding two random signals together, as shown in Figures 18.1 and 18.2. These 
are two significant elements of block diagrams as we found in Chapter 2.2. In 
Section 18.2 we will consider gencral LTL-systems. 


18.1.1 Multiplication of a Random Signal with a Factor 


Multiplying a random signal x(t) with a complex, constant factor K, in accordance 
with Figure 18.1 creates the new random signal 


y(t) = Ka(t). (18.1) 
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We now want to express the auto-correlation function of the output signal g,y(7) 
and the cross-correlation function y,,(t) of the output signal and input signal, 
with the auto-correlation function of the input signal ¢,,(z). 

For the auto-correlation function of the output signal, 


Guy t) = Ely(t + dy"()} = BUKalt + 2)K*2*()} =|KPeee(2) (18.2) 


is immediately obtained. Likewise the cross-correlation function between x(t) and 
y(t) is 


i 


Blylt + e"()} = BUKalt+ 22} =Kyeel®) (183) 
E{a(i+ c)y*(t)} = E{e(t + c)K*0*()} = K*gy,(c). (18.4) 


Pyx(t) 
Pay ( z) 


i 


For the (cross-)power density spectra, corresponding relationships are obtained, 
because the Fourier transform is linear. 
These results can be summarised in a clearer form. 


Yea(t) one yy (jw) (18.5) 

Pyx() = KQz2(t) oe =D, (jw). = yx (jw) (18.6) 
Pay(t) = K*pp5(t) o-e ©y,(jw)K* = Oz, (jw) (18.7) 
Pyy(t) = KPpra(t) o—e Pon (Jw) KL? = Oyy (jw) (18.8) 


x(t) ae y(t) 


K 


Figure 18.1: Multiplication of a random signal with a constant factor K 


18.1.2 Addition of Random Signals 


Figure 18.2 shows two random signals f(t) and g(t) being added to form a new 
random signal y(t). The properties of both random process f{t) and g(t) are 
known, but the properties of the summed process y(t) must. be determined. From. 
the random processes f(t) and g(t) we only expect enough information to form 
auto- and cross-correlation functions, in particular, that f(£) and g(t) are joint 
weak stationary random processes. Complex sample functions are permitted. 
The addition of random signals is the simplest and most frequently used model 
for describing noise-like interference. We can, for example, represent the output 
signal of an amplifier y(t) as the sum of the ideal (noise-free) amplified signal f(¢) 
and the noise g(t). The ideal signal f(¢) can be a speech or music signal and 
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Kit) 


y(t) 
g(t) 


Figure 18.2: Addition of two random signals f(t) and g(t) 


is here described as a random process. Even when this model does not exactly 
reproduce the interference in a multi-stage amplifier, in many cases it still delivers 
a good approximation of the actual relationships. Its greatest advantage is the 
simple analysis that we are about to carry out for the auto-correlation function 
and the power density spectrum, and then for the cross-correlation function and 
crosspower density spectrum. 


18.1.2.1 Auto-Correlation Function and Power Density Spectrum 
The summed signal y(t) from Figure 18.2 is simply 
y(t) = f(t) + g(t). (18.9) 
Its auto-correlation function (17.56) 
Pyy = E{y(t + zy" (t)} (18.10) 


can be used to work back to the auto-correlation and cross-correlation functions of 
f(t) and g(t), with the calculation rules from Chapter 17.2.3. Substituting (18.9) 
into (18.10) yields 


l] 


Ef{(f(t+ 7) + 9+ a)(f(O) +9°@))} (18.11) 
ppt) + Pra(Z) + Gax(t) + Pog) - (18.12) 


Pyy(T) 


I! 


The auto-correlation function yy,(z) is therefore formed from the auto-correlation 
functions of the signals f(€) and g(t) and their cross-correlation functions. 
The power density spectrum at the output is found by Fourier transforming 
(18.12): 
yy (jw) = By s(Jw) + Bpg (Jw) + gp (Jw) + Ogg (jw). (18.13) 


Using (17.74) we can summarise both crosspower densities as a real variable 


D pg (jw) + Pgp(qw) = Byg(qw) + Of (qw) = 2BRe{Pyo(jw)} (18.14) 
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and obtain for the power density spectrum ®,,,(jw), the expression 


Dy (Jud) = Bj (jue) + BRe{® pg (Ges)} + Byglde)] (18.15) 


which is obviously real. 

In addition, the power density spectrum ®,,,(jw) is made up of the spectra of 
the signals f(t) and g(t) and of their mutual crosspower density spectrum. 

The results so far hold for the addition of any two random processes f(t) and 
g(t). Possible correlation between the random processes is taken into account by 
the cross-correlation function yyg(z) and crosspower density spectrum @ y, (jw). 

These relationships become much simpler if both random processes are uncor- 
related and at least one has a zero mean. Then, from (17.55) we obtain 


Pfg(t) =O ove Dyrg(jw) =0 (18.16) 


and the relations (18.12) and (18.15) simplify to 


Pyylt) = pst) + Pqq(Z) (18.17) 
Pyy(jw) = Dre Jw) + Bgq (Fw). (18.18) 


Assuming that the processes are uncorrelated holds in many cases where g(t) 
represents a signal interfering with the useful signal f(t). Examples are amplifier 
noise independent of the input signal or atmospheric effects on radio transmission 
that is likewise independent of the transmitted signal. As this kind of interference 
also usually has a zero mean, the simple relationships (18.17) and (18.18) also 
hold. They say that when two uncorrelated random processes are added, and as 
long as at least one has a zero mean, the auto-correlation functions and power 
density spectra are also added together to form the respective functions for the 
complete signal model. 


18.1.2.2 Cross-Correlation Function and CrossPower Density Spec- 
trom 


We next consider the cross-correlation function between f(t) and the sum y(t) = 
f(t) + g(t) as well as the corresponding crosspower density spectrum. Correla- 
tion between f(t) and g(t) is now permitted. From (17.53) and (18.9) the cross- 
correlation function gy,(z) is obtained: 


[erule) = BF E+ MPO +9 O)}= vr) +e 70(2)-] (08.19) 


The cross-correlation function between a sum term and the summed signal is the 
sum of the auto-correlation function of the corresponding sum term and the cross- 
correlation function between both sum terms. 
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For the cross spectrum the same rule applies using the respective power spectra 
of f(t) and g(t) 


| ®rylGw) = © 5)(jw) + Byq(ju) 5 (18.20) 


These results also become particularly simple if both random processes are un- 
correlated and at least one has a zero mean. The cross-correlation function y f_(z) 
and the crosspower density spectrum ® ¢,(jw) then disappear and we are left. with: 


Pry(Z) yr y(T) (18.21) 
Pry(ju) = Pz (jw). (18.22) 


q 


All results in this section hold correspondingly for the cross-correlation function 
and the crosspower density spectrum between g(t) and y(t). 


18.2 Response of LTI-Systems to Random Signals 


Now that we have defined the statistical description of input and ontput processes 
that arise by addition or multiplication of each other, we can consider the corre- 
sponding relationships for input and output signals of LTT-systems. As description 
forms for LTL-systems, we will choose the impulse response and frequency response. 
No assumptions are made about the inner structure of the system. Next it, must 
be clarified whether the a stationary or ergodic input signal brings about the same 
properties in the output signal. To do this we first derive the connections between 
the different averages at the input and output of LTJ-systems in detail. 


18.2.1 Stationarity and Ergodicity 


We start with an LTI-system as in Figure 18.3 and consider, if the input process 
is stationary or an ergodic random process, then does the output process also 
have these properties? If that is the case, we can also use the correlation function 
and power density description that was introduced in Chapter 17 on the output 
process, under the condition of weak stationarity. 

If the input process is stationary then the second-order expected values do not 
change when the input signal is shifted by time At (compare (17.12)): 


E{f(w(t1), v(t2))} = E{f (x(t + At), w(te + At))}. (18.23) 
Because the system time-invariant, for the output signal y(t) = S{a(t)}, 
y(t, + At) = S{x(t, + At}} , (18.24) 
holds and from (18.23) we obtain 


E {o(y(ts), y(t2))} = EF {g(y(ti + At), y(te + At))} , (18.25) 
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as g(S{x(t1)}, S{a(t2)}) also represents a time-invariant system. The output pro- 
cess is therefore likewise stationary. Corresponding statements about weak sta- 
tionary and ergodic processes can be obtained in the same way. 

Now we know that for an input signal which is 


a) weak stationary or stationary, 
b) weak ergodic or ergodic, 


the output signal also has the same properties. Likewise, input and output pro- 
cesses show the same joint properties. The different relationships are illustrated 


in Figure 18.3. 
++ LTI-system —oe 
x(t) y(t) 


a) (weak) stationary a) (weak) stationary 
b) (weak) ergodic b) (weak) ergodic 
\nommmnresucenutenentitiniemm, putanteunetneceennnctennassntnmasinne! 
a) joint (weak) stationary 
b) joint (weak) ergodic 


Figure 18.3: LTI-system with input signal x(t) and output signal y(t) 


18.2.2 Linear Mean at the Output of an LTI-System 


To determine the linear mean at the output of an LTI-system with impulse response 
A(t) as in Figure 18.4, we start with the convolution (8.39) 


y(t) = a(t) * h(t) (18.26) 
and form the linear mean E{y(t)} = y(t) of the output signal: 
y(t) = Efy(t)} = E{a(t) * A(t)} = E{x(t)} * A(t) = pe (t) * A(t). (18.27) 


The input signal x(t) is a random variable, but the impulse response A(t) is not, 
so the expected value formed with x(t) and y(t) can be expressed by pz, (¢) and 
h(t). Here, x{t) does not have to be a stationary process and this means ju,{t) 
and jty(t) are therefore dependent on time. Comparing (18.26) and (18.27), we 
see that the relationship between the determined linear expected values p.(t) and 
ji, (t) has the same form as the convolution between the input signal x(t) and the 
output signal y(t). 
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Figure 18.4: LTI-system with impulse response h(t) 


If the input signal x(t) is stationary, then the linear mean E{z(t)} = by is 
constant in time and the convolution relationship simplifies to 


by = E{UO}= [pate de = pe - #10). (18.28) 


The constant linear average jz, can be brought outside of the integral, and the 
remaining integral over h(z) can be written as the value H(0) of the Fourier 
integral (9.1) at w = 0. The mean of a stationary random signal is therefore 
transferred like the DC component of a deterministic signal. Thus we obtain the 
simple formula 

[ly = fle  ET(0) . (18.29) 


18.2.3. Auto-Correlation Function at the Output of an LTT- 
System 


We will calculate the auto-correlation function at the system output for a station- 
ary input signal. The auto-correlation function 


Pyy(z) = E{ye + cr) y"(O} (18.30) 


is obtained from the auto-correlation function ~,.(z) of the input signal and the 
impulse response h(t), by using convolution (18.26) and some rearrangements. The 
aim of the rearrangements is to move the expectation operator into the resulting 
integrals and apply it to the input signal. 

In the first step we express the output signal y(t) in (18.30) with the convolution 
integral: 


l= e [rue +c— pe) dp [wwe —v) wh (18.31) 
te du 


Bringing both convolutions together to form a double integral, sorting the terms 
within the integral and using the expected values on the resulting product of the 
input signals yields 


Pye) = f [ ru) h*(v) ny at +er~—p)a*(t—- »| du dy . (18.32) 
vd 
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The expected value is now formed from the product of the values of the input signal 
at different time points and therefore represents the auto-correlation function of the 
inpul. signal. Because the input signal is stationary, the auto-correlation function 
depends on the difference between the time points t+ 7— pu and t-- 1% 


eolt)= ff nun) pexle— n+ v)duav (18.33) 
vs tt 


We have now found the first. connection between the auto-correlation functions at 
the input Yze(c) and at the output Yyy(z). 

We can further simplify the rather involved expression (18.33), by recalling the 
correlation of deterministic signals introduced in Chapter 9.9. To use the definition 
of the auto-correlation function for deterministic signals, given in (9.103), we first 
substitute 6 = jo — v into (18.33) and obtain 


ema) = ff h(uynr(n— 0) du ere 8) 48. (18.34) 
JOS ts 


After-another substitution \ = j.-~ @, we recognise in the inner integral the auto- 
correlation function yp, (0) as in (9.103): 


Pan(O) = i 


aed 


h(w) h* (uw — @) du = fro + A) h*(A) dd = h() « h*(-@). (18.35) 


Despite having the same notation, the auto-correlation function ¢,,(@) does not 
represent an expected value of a random process, as the the impulse response h(t) 
is a deterministic function. We can, however, interpret y,_;,(?) as an expected 
value of h(A + @)h* (A), like we did with the random processes, if we define the 
expected value for deterministic functions with the integration in (18.35). As the 
auto-correlation function yp,(@) describes the LTI-system, it is also called a filter 
auto-correlation function (filter ACF). Describing deterministic LTI-systems using 
characteristics which are similar to those for random signals has the advantage that 
it allows the initially cumbersome expression (18.33) to be represented in a simpler 
and more easily remembered form. To derive such an expression we put (18.35) 
into (18.34) and obtain 


Pyy(Z) = i Pnn(9) Yuxl —6)db = Pnn(Z) * Puclt) . (18.36) 
The auto-correlation function at the output y,,,(z) is now obtained as convolution 
of the auto-correlation function at, the input ¢,.,(c} with the filter auto-correlation 
function y_,(c). The filter auto-correlation function is itself the convolution of the 
impulse response h(t) with A*(—t). In this way the relationship between the auto- 
correlation functions at the input and output of an LTT-system and its impulse 
response can be summarised with two simple equations: 
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(18.37) 
(18.38) 
(18.39) 


The mean square as a measure for the power of the output signal is obtained by 
evaluating the convolution integral at ¢ = 0: 


Ef{ly(t)|?} = Yyy(0) = f Pra(®) Poe(—zt) dz. (18.40) 


Example 18.1 


We will consider an ideal delay circuit with the impulse response 
h(t) = d(t ~ te). 
With (18.38) and (18.39) we obtain 
Pra(t) = 6(c—to) *d(—7 — to) = d(z) 


Pyy(t) = 6(z) * Peel T) = Pex). 


The ACF is not changed by the delay circuit. 
ae 


For discrete systems with impulse response h{k] there are similar relation- 
ships for the auto-correlation sequences of the output signal. With the defi- 
nition of discrete convolution (12.48) as a sum, the formulae for discrete sys- 
tems look exactly like the expressions (18.38), (18.39) for continuous systems: 


Pyy[A] = Phnik ] * Sax {s] (18.41) 
Pals] hlq] * R*[—K) (18.42) 


i 


18.2.4 Cross-Correlation Function Between the Input and 
Output of an LTI-System 


The cross-correlation function between the input and the output of an LTT-system 
can be obtained with a similar procedure to that for the auto-correlation function. 
For a stationary input signal, starting with 


Poy(t) = E{a(t + cr) y"(¢)} (18.43) 
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the convolution integral is inserted 


Puy(t) = Bf a o) fe (w)a*(t — p) an} ; (18.44) 
io 
then interchanging the sequence of integration and expected values yields 
Puy(Z) = [rE + r)a*(t—p)} dp. (18.45) 
fa 
In the expected value we again recognise the auto-correlation function of the input 
signal 2(t): 
Pay(Z) = [rw Pan(t + pw) du. (18.46) 
jt 


By substituting v = ~j: we finally reach the desired expression for the cross- 
correlation function of the input and output of an LTI-system and its impulse 
response: 


Pay f= / h*(—V) Gag (t —v) dv = h*(~r) * Yau (r). (18.47) 


The formula obtained for the cross-correlation function y,,.(z) between the in- 
put and output is easier to remember. To derive it from (18.47) we first make 
use of the symmetry relationships for correlation functions from Chapter 17.4.2. 
From (17.54) in combination with (18.46) we obtain 


Puale) = Py(—t) = f hu) ore(—e + wd. (18.48) 


J he 


The conjugate symmetry of the auto-correlation function (17.58) yields 
eyele) = f Alu) Poole ~ 1) dye = A(e)* Peele): (18.49) 
Jb 


Both possible cross-correlation functions between the input and output of an 
LTI-system are easily obtained by convolution of the auto-correlation function at 
the input with the impulse response h(c) and h*(—7):' 


Pa ( 
h(z) * Pua(T) . (I ‘ 
( 
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Example 18.2 


We again consider the ideal delay circuit from Example 18.1, and with (18.52) 
find 
Pya(t) = 5(z — to) * Pelt) = Pra (zt — to). 
The cross-correlation function between the input and output of a delay circuit is 
simply a shifted version of the auto-correlation function. This simple insight is 
used in many engineering systems to measure signal delay, for example, radar or 
sonar. 


a 

According to the continuous case, for a discrete LTI-system with impulse re- 
sponse h[k] holds Gayle] = hb [—K] * Geek] (18.53) 
(18.54) 
Pyalk] = Als] * Prelr]. (18.55) 
(18.56) 


18.2.5 Power Density Spectrum and LTI-Systems 


We have now derived the relationships between the correlation functions at the 
input and output of LT]-systems and the impulse response. They turned out to be 
very similar to convolution of a deterministic input signal and impulse response. 
An even simpler description can be obtained in the frequency-domain by multi- 
plying the input spectrum with the frequency response of the LTI-system. As we 
have already met the power density spectrum as a frequency-domain description 
of random signals, it is reasonable to assume that there are some similar relation- 
ships between (cross-)power density spectra at the input and output of a system 
and its frequency response. 

We will start with the cross-correlation function (yy,(z) as in (18.52). Fourier 
transformation ®,,(jw) = F{pz2(z)} of the ACF (17.69) and the CCF (17.70), 
yo: (fw) = F{eyo(z)}, and the convolution theorem (9.70) yields 


G,.(jw) = Bez (qw)H (jw). (18.57) 


The cross-power density spectrum ©,,.(jw)} is obtained from the power density 
spectrum ®,,.(jw) of the input signal by multiplying it with the frequency response 
H (jw) of the LT L-system., 

The cross-power density spectrum ®,,,(jw) could also be derived in the same 
way from (18.51), using Fourier transformation. We can obtain it more quickly 
from (18.57), however, with (17.74) as 


Gay (gw) = Ore (jw)H* (jw). (18.58) 
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Here we have used the fact that the power density spectrum ®,,,,(jw) is real (17.73). 
For the power density spectrum of the output signal ©,,,(7w) a simple relation- 
ship can be found by Fourier transforming (18.38). The Fourier transform of the 
ACF gapn(t) can, after the results of Chapter 9.9.2.4 (Correlation of Deterministic 
Signals), be expressed by the magnitude squared frequency response H (jw): 


pnn(t)o—e Ppp (Jw) = H(jw)H* (gw) = |A(jw)|? (18.59) 


yielding 
Dy (jw) = Bae (ju)|H (jw)? . (18.60) 


The significant relationships for correlation functions and power density can 
now be summarised in a clearer form: 


» 


Pra(t) oe Byn (ju) (18.61) 

Pya(t) = A(z) * Pra(t) o—* O,,Qw)H (jw) = Bye (gw) (18.62) 
Puy(t) = h*(—c) * Gag (Zt) oe Bye (jw) H*(qw) = Bay (jw) | (18.63) 
Pyy(Z) = Pran{Z) * Pox (TZ) OB ®,.(jw)|H (gw)? = Dy (Jw) : (18.64) 


Equations (18.61) to (18.64) have the same form as the corresponding 
equations (18.5) to (18.8) for multiplication with a complex constant 
Kk. The expressions obtained are a special case of (18.61) to (18.64) for 
Hijw)=K e—-o h(c)=K6(r). 

The results obtained in the preceding sections can be made even clearer 
and more general. Instead of the auto-correlation function y,,(z) or the cross- 
correlation function Pya(z), we could have used the cross-correlation function 
Pyr(z) with any other random signal r(t), as shown in Figure 18.5. The same 


known unknown 


Pyp(t) | | Py-(t) 


1) Se ee 10) 
Figure 18.5: CCF of a signal with the input and output of an LTl-system 


steps as in the derivation of ¢,,(z) in Section 18.2.4 would then have lead to 


Pyr(Z) aaa Pur (t) * h(z) 5 (18.65) 
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and the corresponding representation in the frequency-domain, in accordance 
with (18.57) and (18.58) 


®o.(gw) H (jw) (18.66) 
Pra (jw) H* (gw). (18.67) 


Using a suitable substitution for r, equations (18.62) to (18.64) can be found 
from the last two expressions. From (18.66) we let r = @ and r = y, and obtain 


Dyn(juw) = Oye(ju) (jw) (18.68) 

Pyy(jw) = Sy,(jw) Hw) (18.69) 
and from (18.67) for r = x 

Poy (jw) = Pyn(Jw) H* (gw). (18.70) 


Finally. (18.69) and (18.70) yield 


Py, (Jw) = Dey (Jw) (jw) = oe (jw) H* (jw) H (gw) aa G27 (jw)| H (jw)/? . 
(18.71) 
It is therefore sufficient to remember formulae (18.66) and (18.67); all of the impor- 
tant relations between the (cross-)power density spectra at the input and output 
of LTI-systems can be derived from them. 


~ Example 18.3 
A typical stock exchange index x(t) has a power density spectrum of the form 
2a 


Byo(jw) = eons. ? 

where a is very small, The change of the index with time conveniently produces a 
differentiator with the transfer function 

AH(gw) = jw. 
The resulting derivative y(t) = #(t) has the power density spectrum 
2aw* 
yey) sje i) eee 

Dyy (Ju) = WwW ®5.(jw) ™ Ww ae ae 3 

For w? >> a?, 

Oy (jw) = 2a. 
The corresponding ACF is 

Pyy(t) & 2ad(r). 
Sequential changes of the stock exchange index are therefore completely uncorre- 
lated. 
el 
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18.2.6 Interpretation of the Power Density Spectrum 


We can explain the interpretation of the power density spectrum (which should 
actually be called the autopower density spectrum) with a thought experiment. 
We start with a random signal z(t) which has power density spectrum ®,_,(jw). 
It will be filtered through an ideal band-pass filter with frequency response 


1 for wo Sw < wo + Aw 


BOY = { 0 otherwise t2) 
We have already encountered band-pass filters of this kind when we looked at sam- 
pling complex band-pass signals in Chapter 11.3.3. Because they do not have con- 
jugate symmetry they have complex impulse responses, and they produce complex 
output signals from real input signals. However, this is not necessarily a problem; 
we will imagine that Aw is very small, and the band-pass therefore lets through 
only a very narrow frequency band. 


H(ja) 


10 


onimmeeenmemten ad 
g *@gt+A@ (a) 


Figure 18.6: Band-pass which has been shifted to the right, and is therefore complex 


To determine the power of the output signal, we calculate the quadratic mean. 
of the output signal y(t) = A(t) * z(t). We use the inverse Fourier transform of 
©,,(jw) from (18.64), instead of the convolution integral as in (18.40): 


ae 1 f° : nia 
EIR} = 52 [ Soa(de) LH Gw)P a. (18.73) 
WJ moo 


As H(jw) has a narrow band character, the integral with respect to w only covers 
a narrow band of the power density spectrum ®,..(jw), of width Aw: 


7 1 wobtAw 1 
E{ly(t)2} = + | Dao ju) ds & Ban jive) Aw. (18.74) 


2 
al Jag 


The power density spectrum represents the distribution of a random signal’s power 
onto an infinite number of infinitesimal frequency bands of width Aw. This justifies 
the name power density and confirms the interpretation from Chapter 17.5.2 (see 
Figure 17.9). At the same time we can obtain 


Gi0(jw) 20 Vw, (18.75) 
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which we gave in Chapter 17.5.2 without proof. 

The interpretation of the cross-power density spectrum ®,,(jw) between a 
signal a(t) and a reference signal r(f) can be carried out similarly, in principle, even 
though the result is not quite so descriptive. Again having in mind the analysis of 
x(t) into many narrow band pass signals according to (18.66), ®,,(jwo) turns out 
to be the cross spectrum ®,,(jwo) of the frequency component y(t) = a(t) * h(t) 
with frequency wp. 

If the reference signal r(t) is also filtered with a corresponding band-pass filter, 
the cross-power spectrum does not change. Clearly only components of the same 
frequency contribute to the cross-correlation between two stationary signals. The 
correlation between. these band-pass components is recorded in the cross-power 
density spectrum. If there is a fixed amplitude and phase relationship between 
x(t) and r(t), it will appear in the cross spectrum. If the frequency components 
do not correlate, ®,,.(jw) = 0. 


18.2.7 Measuring the Transfer Behaviour of an LTI-System 


The transfer behaviour of an LTI-system is completely described by its impulse 
response or transfer function. There are various ways of measuring them. Theo- 
retically it is possible to excite the system with a delta impulse and measure the 
output response but, in practice, the high amplitudes required for an approxima- 
tion of the delta impulse cause many problems. Another way is to excite the system 
with a sine wave with varying frequency and measure the frequency response, with 
the amplitude and phase of the output signal. A prerequisite is that apart from 
its response to the sinusoidal input signal, the output signal may not contain any 
interference, because otherwise it would falsify the measurement. Beyond that, 
the frequency of the sinusoidal signal can only be changed slowly enough that no 
undesired transients appear. 

A better, more modern method uses a wideband noise signal and statistical 
analysis of the output signal. One corresponding measurement setup is shown 
in Figure 18.7. The wideband measurement signal at the input is described as 
white noise. This approximation is always justified if the bandwidth of the noise 
source is much greater than the bandwidth of the system under investigation. The 
uuknown transfer behaviour is obtained from the cross-correlation between the 
input and output signals. 

For white noise with noise power No = 1 (see Chapter 17.5.4): 


Pua(t) = 6(z) oe Po2(gw)=1 . (18.76) 
For the cross-correlation function y,,.(c) between the output and input, and for 


the cross-power density spectrum ®,,(jw) follows from (18.62): 


Gye(t) = Pox(t) *h(e) = d(z) * A(z) = A(z) (18.77) 
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noise 
source 


Pyx(TI=HAT) 


ccf 
"| measurement 


Figure 18.7: Analysing an LTI-system with white noise 


a—oO 


Pye(jw) = H(jw). (18.78) 


The cross-correlation function g,¢(z) and cross-power density spectrum 
®,.(jw) immediately give the impulse response and transfer function of an un- 
known LTI-system. If the signal y(t) is overlapped by a noise signal n(t), the result 
remains unchanged, as long as x(t) and n(t) do not correlate (Exercise 18.17), 


18.3 Signal Estimation Using the Wiener Filter 


The field of signal estimation concerns reconstruction of a signal that has been 
corrupted by various influences. The original signal is corrected as much as possible 
using knowledge of the statistical properties of the corrupting influence. If we are 
dealing with weak stationary random processes and LTI-systems, then we will be 
able to put the theory we developed in Section 18.2 to good use. 

The problem is depicted in Figure 18.8. The original signal s(¢) is not directly 
accessible; only the signal x(t) can be observed. The influence which corrupts the 
original signal before it is observed will be described with the properties of an LTT- 
system and additionally, an interference signal (noise) with a random character, 
No details about the structure of the LTI-system and the noise signal are known. 
We will assume that we only know the cross-power density spectrum ®,.,(jw) 
between the original signal s(t) and the observed signal x(t), for example, from 
measurement with a known original signal. The cross-power density spectrum is 
a mathematical formulation of the influence for the corrupting influence on the 
original signal. The power density spectrum ©,,(jw) of the observed signal can 
be determined by measurement at any time, and is thus also known. 

The filter 7 (jw) will be developed so that its output signal y(¢} comes as close 
to the original signal as possible. The task of the filter is therefore to eliminate 
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ner | observation 
original ! x(t) 
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+ : be 
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Figure 18.8: Estimation of the original signal s(t) 


the influence on the original signal. In the following sections we will develop a 
method that provides a suitable transfer function /7f (jw) from the known quantities 
©,,(jw) and ®,,(jw) in a systematic way. The filter is called an eptemal or Wiener 
filter. 

Estimation of this kind is necessary in many different applications as these 
examples show. 


Measurement In this case s{¢) is a physical quantity whose time-behaviour is 
measured. As each measurement affects the process being measured, the mea- 
suring device gives an inaccurate observed version x(t) of the original signal s(t). 
Additionally, errors in measurement can be modelled using noise signals. 


Signal transmission If a signal s(t) is to be transmitted to another location, 
it will be aflected by the non-ideal properties of the transmission chain and may 
also be subject to interference, so the received signal x(t) no longer corresponds 
to the transmitted signal s(¢). 


Recording In order to store a signal s(t), it must be changed so that it complies 
with the requirements of the target medium. The signal x(t) read at a later time 
contains influences from the recording and reading equipment, and the interference 
here can also be modelled as noise. 


18.3.1 Deriving the Transfer Function of the Wiener Filter 


To derive the optimal transfer function H (jw) we first of all need to find a mathe- 
matical approach which should precisely formulate the requirement that the output 
signal y(t) is ‘as similar as possible’ to the original signal s(t). To achieve this, we 
will introduce a measure for the difference between s(t) and y(t), called the error 
power or the estimation error 


e(t) = y(t) — a(t). (18.79) 
We represent the error power using the expected value 


EX|e(t))?} = E{ly(e) — s@)/*}. (18.80) 
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Although we do not know the original signal s(£) or the reconstruction error e(t), 
we can express its power with known statistical quantities. 

We know from Chapter 17.5.2 that the mean square F'{\e(t)|?} can also be cal- 
culated by integrating the power density spectrum ®,.(w) (compare Figure 17.9). 
We will therefore consider the power density spectrum ®,,.(jw) of the reconstruc- 
tion error e(f), and try to make it as small as possible. ®,,(jw) is expressed by 
the power density spectra ®,, (jw) of the output signal and ®,,(jw) of the original 
signal. From (18.79), with expression (18.13), we obtain 


Bee = By — Dy, — By + Bas (18.81) 


for the addition of random variables. Here the argument (jw) is left out to simplify 
the notation. 

‘To determine the transfer function H of the estimation filter, we need an 
expression for the power density spectrum ®,., dependent on H. Using (18.64) 
and the general relationships (18.66) and (18.67) with r = s, the correlation with 
y can be expressed by the correlation with 2: 


Dee = ©), H A” — Dus Ht — Doe T* + Deg (18.82) 


The estimation filter H that leads to the smallest error power is obtained 
from (18.82) by differentiating 6. with respect to H. It should be noted here 
that the variables in (18.82) and H are both complex. Therefore we write (18.82) 
dependent on the magnitude |H| and phase ¢ of the frequency response 


H = |H\e?? (18.83) 


and obtain 
oo = Op, |HP? — By, |Hle? — By, |Hle 7? + Bye. (18.84) 


We can now differentiate with respect to the real variable || 


ee 


iis |H| Byy — By, e?? — B*, e771? = 2|H| Pez — 2Ref{H,.e7°} = 0 (18.85) 


The optimal magnitude response |H| is determined from the requirement that the 
derivative of ©, with respect to |H]| is zero: 


neta) 


|| o 


(18.86) 
The phase ¢ is determined in the same way by differentiating ®.. with respect to 
@ 

AD e¢ 


a eb GY =O, (18.87) 


=—j|H\e’?,,+ j|H 
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The optimal phase @ can be derived from 
Im{,, €7%} = Im{|6,,| FAP +e) — 9 (18.88) 
where the imaginary part becomes zero when the phase is 
o = —arg{®,,}. (18.89) 


The phase response of the estimation filter is therefore chosen to be equal to the 
negative phase response of the cross-correlation function ®,,. The magnitude |/7| 
is now also completely defined, because from (18.86), and (18.89), we find 


— Ref{Sp, 6} — Re{|bas[eAeuHO} — |, 


| | 
laa Pas oar ee ey) 


With (18.83), the complex frequency response of the estimation filter can be ob- 
tained from (18.89) and (18.90). 


O7.Gw) _ PseGw) 


HGu) = eGo) BralJu) 


(18.91) 


This estimation filter corrects the observed signal x(#) such that the deviation 
of the result y(t) from the original signal s(t) exhibits the smallest error power 
possible. We derived this result without knowing the original signal s(t), Anyway, 
the description of random processes by mean values and power spectra enables the 
construction of an optimal estimation filter. The estimation filter given by (18.91) 
is called a Wiener filter, according to Norbert Wiener (1894-1964), a pioneer of 
estimation theory. 


18.3.1.1 Linear Distortion and Additive Noise 


The derivation of the Wiener filter as in (18.91) is general because we required no 
knowledge of the kind of signal interference. The result can be illustrated by using 
a common model for signal interference from deterministic and random sources. 

Figure 18.9 shows the same set-up as in Figure 18.8. The interference source is 
in this case more accurately modelled by an LTI-system with frequency response 
G(jw) and an additive noise source n(t). The frequency response G(jw) can, for 
example, stand for the frequency response of an amplifier, a transmission cable, or 
a radio channel. All external interference sources are summarized by the additive 
noise signal n(t). The noise signal may not correlate with the original signal s(t). 

We derive the frequency response for this set-up of the Wiener filter from the 
general case in (18.91), using (18.64) and (18.66). First, we obtain 


Dye — O..G (18.92) 
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from (18.66). For the cross-spectrum ®,,, we use (18.22) and (18.64) to obtain 
Oy, = Oy, = Os,GG". (18.93) 
From (18.92) and (18.93), we finally find 
Boz = Dag", (18.94) 
The power density spectrum is obtained from (18.18) and (18.64) 
Bae = Buy + Ban = Bss|GP + Onn. (18.95) 


If we now put equations (18.94) and (18.95) into (18.91), we obtain the Wiener 
filter for the set-up in Figure 18,9 


(18.96) 


| ; Poo ( Gu )G* (Fw 

| H(jw) = =— sete Ge) 
= ®.. (Gw)lG (ju)| + Onn (jw) 
Knowing the frequency response G(jw) makes it possible in this case to find from 
the cross-power density spectrum ©,,(jw), the power density spectrum ®,,(jw) 
of the original signal and ©®,,,,(jw) of the noise signal. 


original noise | observation 
signal a(t) | x(t) 
} 
| dl 
G(jo) ilter : 
s(t) v(t) H(jw) y(t) 


| 
} 
| 
Figure 18.9: Reconstruction of a signal with linear distortion from additive noise 


18.3.1.2 Ideal Transmission and Additive Noise 


From the form of the Wiener filter in (18.96), we can derive two important special 
cases, whose mode of operation we can easily see. First we assume an ideal transfer, 
with G(jw) = 1, so that the original signal is only distorted by the additive noise 
(see Figure 18.10). The task of the Wiener filter is then reduced to finding the 
best possible suppression of the noise signal n(t). The corresponding frequency 
response is 


Baaldu) 
Do5(Jw) + nn Gw) 


H(jw) = (18.97) 


The mode of operation of the filter can be derived directly from the frequency 
response (18.97): 
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noise observation 


a(t) x(t) 


| 


original 
signal 


de-noising 
filter 


H(jo) y(t) 


Figure 18.10: Filter for removing additive noise from a signal 


e For @,,(jw) > ©,,,(jw) the signal power dominates, and the filter allows 
the signal and the low-power noise to pass through unhindered: H(jw) = 1. 


e For ©,,(jw~) < ®,,(jw) the noise dominates, and the filter bars both the 
noise and the smaller signal component: H(jw) 0. 


Figure 18.11 shows an example of an original signal with a strongly frequency- 
dependent power density spectrum and a noise source that produces white noise. 
The filter lets the frequency components pass where the original signal outweighs 
the noise, and stops the frequencies where the original signal makes no contri- 
bution. If both power density spectra are of the same order of magnitude, the 
frequency response of the filter takes a value between 0 and 1. 


100+. 
~ 8S 
10 SS 
1 * Pon ee 7 
0.1}. ce - . 
aM 
. P.. >>Dy, 
Ago) res &,.=0,, 
“s os re 1 
\ Z 2 
\ Sac aN mCI ey arr 
Nie 
0 


NS 


F 7) 
Poe << Pay 
H =0 


Figure 18.11: Power density spectrum ®,,(jw) of the original signal, Onn(yw) of the 
noise, and frequency response H(jw) of the Wiener filter. 
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18.3.1.3 Linear Distortion Without Noise 


The other special case that we can derive from the frequency response (18.96) 
of the Wiener filter is identified by removing the noise source: ®,,(jw) = 0. 
The original signal s(t) is then only corrupted by the LTI-system with frequency 
response G(jw). The frequency response of the Wiener filter then takes the form 


100 _ Bo5(jw)G* Gu) 1 


®,,(jw)|G(Qqw)|2 GQw) (18.98) 


which means that it is trying to remove the effects of the distorting system G(jw). 
As long as |G(jw)| 4 0, this will be successful, and is even independent of the power 
density spectrum ®,,(jw) of the original signal s(t). We have already discussed 
this case in Chapter 8.5.2 ‘de-convolution’, but because the noise was disregarded, 
it was not quite complete. In addition, we have to bear in mind the stability of 
H(jw) (Chapter 17.3.1). 


18.4 Exercises 


Exercise 18.1 


A complex constant C will be added to a stationary random signal x(t) with 
average ft, and ACF y,,.(7). 
Cc 


x(t) y(t) 
Find ya2y(z) and Yy,(z) 


a) using the definitions of the CCF and ACF, (17.53) and (17.56) 
b) with Sections 18.1.2.1 and 18.1.2.2. 
Exercise 18.2 


The following system has complex constants A and B and a stationary complex 
input signal a(t) with ACF ~,,(z) and average jlz:. 


x(t) ! (0) y(t) 
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With Section 18.1, find 

a) Poo(Z) 

b) Pyy(e) 

C) Yxv(z) 

Note: use the answer from Exercise 17.10. 
Exercise 18.3 
For the system from Exercise 18.2, find yay(z). 

a) Use the definition of the CCF (17.53). 

b) Can the problem also be solved with (18.61)-(18.64)? Justify your answer. 
Exercise 18.4 


Consider the following system with 2 inputs and 2 outputs and complex constants 
A and B. The random processes u(t) and v(t) are stationary, have zero mean and 
are complex. 


pom ee ee 


| 
u(t) w(t) 


B A | 
Wo ee) 


From the given correlation properties gyu(Z), Poy(z) and Guu(t), find 


a) the ACF of w(t) 


b) the CCF between v and w 
c) the CCF between w and v 
d) the CCF between u and w 
e) the CCF between w and u 


Use only the definition of the CCF for complex signals (17.53) and the expression 
(17.54). Finally, verify results a), d) and e) with Section 18.1. 


Exercise 18.5 


The linear combination z(t) = Ax(t) + By(t) is formed from two independent 
random processes x(t) and y(t). A,B € IR, and w(t) has a zero mean and y(t) has 
mean fly. Find gz.(z),yz(z) and y,.(z). 
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Exercise 18.6 
A linear, time-invariant system is described by its transfer function 


gs? ~25642 


H(s) = (s + 2)(s2 + 2s + 2) 


Its impulse response is h(t). 


a) Calculate the filter ACF yjp(z) and sketch its response. 


the auto-correlation function yy,(z) and the power P, of the output signal 
y(t). 


Exercise 18.7 
A system has the impulse response h(t), an input signal a(t) and output signal 
ti stationary and has a zero-mean, Y_2(t) = 4(z) and A(t) = si(t). 
Find 

a) the power density spectrum of x(t) 

b) ple and ply 

c) pan(t) 

d) Pyy(t) 

e) Yay (TZ) 

f) Power and variance of x(t) and y(t). 
Exercise 18.8 


A system has the transfer function 


, ue w 
H(jw) = cos(5~—w)rect( 5) 
g g 


a) Determine the impulse response h(t). 
b) Find the filter ACF gap(z) 


c) At the system input a signal is applied with power density ®..(jw) = No + 
mé(w). Find the ACF of the input signal y..,(z) and the mean jy. 


d) For the output signal y(¢), find the mean fy, the auto-correlation function 
Pyy{z), the output signal power P, and the power density spectrum ®,,,(jw). 
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Exercise 18.9 


A system with the transfer fiumction 


gs—l 


saa eee Fare 


is excited by white noise with power density No. Determine the auto-correlation 
function, the mean and the variance of the output variable y(t). 


Exercise 18.10 


A system with transfer function H(s) is driven by a white noise signal x(t) with 
power density Ng. The auto-correlation of the output signal is measured y,,,(z) = 
Noge~“l4l, where a > 0. 


a) Determine a possible transfer function H(s) for the system. 
b) Can the transfer function be unambiguously determined? 


Exercise 18.11 


Two causal LTI-systems are described with their impulse responses Ai(t) and 
h(t). They both have a stochastic input signal 2(t) with auto-correlation function 
Yra(t). Two stochastic output signals y,(t) and ye(t) are produced. 


a) Express the auto-correlation functions y,,y,(z) and Yy.y,(7) of the output 
signals with the given signal and system descriptions. 


b) Determine the cross-correlation functions gy, c(t) and Yy,x(Z). 

c) Give the corresponding cross-correlation function ~y, 4, (7). 
Exercise 18.12 
Derive (18.54) from the CCF of complex random series Yz,[K] = E{x[k+x]2*[k]}. 
Exercise 18.13 
Derive (18.41) from the ACF of complex random series Yz2[s] = E{a[k+«]2*[«]}. 
Exercise 18.14 


The following set-up is often used to generate a signal with the spectral properties 
of a discrete speech signal, where Yry|k] = dj[k}. 


462 18. Random Signals and LTI-Systems 
a) Calculate the frequency response H(e“’) of the system with output n[k] and 
output s{kl. 
b) Calculate ®,,(e7”) and sketch it (e.g., with MATLAB). 


Exercise 18.15 


A transmission channel is characterised by the following system with real constants 
a and b: 


x(t) 


The interference n(t) does not correlate with «(t), Both signals are white noise 
with power densities &,,,(jw) = No and ®,,(jw) = 1. 

Determine the transfer function H(jw) of a system that reconstructs a signal z(t) 
from y(t) with minimal mean square error. The reconstructed signal at the output 
of H(jw) should be denoted by #(t). 


a) Which statistical signal properties must be known to solve the problem? Give 
H(jw) dependent on these variables. Is the solution optimal with respect to 
the task set? 


b) Find H(jw) as well as z3(jw) for the transmission channel shown above 
for a = 1 and b = 100. Set No = 0. Sketch ®p2(jw), Oyy (jw), |A(jw)| and 
74(jw) in logarithmic form for 107? < w < 10*. 


¢) Solve b) for No = 9999. Instead of ©,,,(jw), sketch the behaviour of ©... (jw): 
|G(gw)|? and for comparison, also plot ®p»(jw) in the same diagram. 
Note: treat the sketches in the same way as Bode diagrams, or plot the curves 
using a computer. 
Exercise 18.16 


The transmission of a signal s(t) is subject to interference from noise n(t) and 
distortion from G(s), as shown in the illustration. 


n(t) 


s(t) (+) (0) G(s) x(f) s(t) 
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The signals s(t) and n{t) are uncorrelated. 
Determine the Wiener filter H(jw) that will try to reconstruct the original signal 
s(t) from x(t): 
a) generally, depending on ®pn (jw), ®s5(w) and G(jw), 
w 


b) for Ban (jw) = 1, By4(jue) = reet(;~-) and G(s) = a. 
gq ees 


Exercise 18.17 


The frequency response H(jw) under the influence of interference n(t) is measured 
with the arrangement from Figure 18.7. 


n(t) 


x(t) (+)——> y(0) 


Show that ®,,.(jw) = H(jw) holds when y,,(z) = d(z) and when n(t) and 
x(t) do not correlate. 
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Appendix A Solutions to the Exercises 


Solution 1.1 


1.) discrete-amplitude, discrete-time, i.e., digital 


fac] 


b) continuous-amplitude, discrete-time, i.e., not digital 


d) discrete-amplitude, continuous-time, not digital 


e 


c) continuous-amplitude, continuous-time, not digital 
} continuous-amplitude, discrete-time 


f) continuous-amplitude, continuous-time 


Solution 1.2 


If a hard disk is considered a “black box”, a digital signal is saved on it as a series 
of ones and zeros. 

If, however, the inner workings are considered, it must be more precisely de- 
fined: 

The bit-stream to be written is digital. The write voltage has discrete ampli- 
tude but is continuous-time, so it is neither an analog nor a, digital signal. The 
magnetic field strength in the disk and the read voltage are continnous-amplitude 
and continuous-time signals, ie., analog. The read is converted by recovering the 
clock signal and a hard decision into a series of ones and zeros, and is a digital 
signal. 


Solution 1.3 


a) #1: analog, as it is continuous in time and amplitude 


Zz: analog (although x2 only changes its value at certain points in time, it 
is defined at every point) 


x3: discrete-time, discrete-amplitude, digital 
b) System 1: linear, time-variant, analog, with memory, causal 


System 2: non-linear, time-invariant, neither analog nor digital, memoryless, 
causal 
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Solution 1.4 


2) 
b) 
c) 


e) 


h) 


i) 


linear, time-invariant, memoryless and therefore also causal 
non-linear, time-invariant, memoryless, causal 


linear 

time-invariant, as the response to an input signal shifted by z is the same as 
the output signal shifted by c: S{a(t—r)} = a(t-7-T) = y(t—-7) 
causal, as the output does not depend on future input signals 

with memory, as the delay requires that the signal is saved 


linear 
time-invariant, see c) 
not causal as the output is equal to the input signal in the future! 


with memory, as the response to the input signal also depends on other 
points in time 


linear 
: da(t—¢ 
time-invariant as S{a(t—z)} = a) = y{t—z) 
with memory, causal 
linear 
time-invariant as 
4 t nat! —-T it~ (a : 
S{et-c}=% f et’-—c)d’ =" f a(n)dn=y(t— 2) 
tT t-T+T 


causal 
with memory as all past values from t = 0 are saved 


linear, time-invariant, causal, with memary 


linear 
time-variant as S{x(t- z)} = 2(t—7-—T(t)) £ y(t— 7c) = e(t- e—-T(t— 2)) 
causal, with memory 


linear, time-variant, not causal, with memory 


x 


cannot be realised 
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Solution 1.5 


a) S, is linear as the response to a linear combination of multiple inputs 


b 


S\{Aza(t) + Ba, (t)} = m- (Arg(t) + Bap(t)) - cos(wrt) 

is equal to the linear combination of the individual response 

ASi{a@q(t)} + BS {xp(t)} =m- Arg(t)- cos(wyt) + m+ Bap(t) - cos(wrt). 
S2 is non-linear, as 

So{Aza(t) + Bay(t)} = [1 + m(Aza(t) + Bap(t))] - cos(wrt) ¢ 

ASp{%q(t)} + BS2{xy(t)} = [A+ Amz, (t) + B+ Bma,(t)| - cos(wrt). 


— 


51 varies with time because 
Si{a(t—-T)} = ma(t-T)-cos(wyt) 4 wm (t-T) = ma(t—T)-cos(wr(t—T)), 


the same holds for So. 


c) S; and S2 are real as from z(t) € IR we obtain: y;2(t) € R. 


d) S, and Sp are memoryless, as the input signal is only used at time tf. 


Solution 1.6 


We 


know from 3. that the system is not linear and time-invariant at the same 


time. It could, however, be either one of the two, and it is not possible to say 
which. 


Solution 2.1 


a) Show that: 


b 


N M 
> USD = d*a(t — r) 
2=0 oat . k=0 a 


: F di d(t— 
Substituting variables t’ =t—<« > “ = ano) =1 > dt=dt',ie., 
the substitution leads to the above equation. 


) If hi is the system response to 21 and yo the response to x9: 


k( Ar, + Brg) i) dP ( d* (xo) 
lan Be) a 7 a =4 Da ee dot ek 
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N 


N . N 
_ (yi) _d'(ys) d'( Ay, + Bye) 
=4 Yas a te oe = a 


4 
a0 az=0 dt 


Solution 2.2 


3rd order system. Direct form II is canonical as it uses the minimum number of 
energy stores (integrators). By setting the coefficients ag = 0.5; a, = 0; ag = —3; 


a3 = 1; bo, = 0; b2 = 0.1 and 63 = 1, we find the block diagrams shown in Figs. 
2.1 and 2.3. 


Solution 2.3 


Solution 2.4 


a) Block diagram 


b) A canonical form is found by interchanging the left and right sides and 
using a common differentiator. It does not have to fulfill any conditions as 
differentiators with the same input signals have the same output signals. 


Solution 2.5 


a) The state-space representation is given by 


~50 OO —0.5 0.5 
Zo 0 -20 -0.2 | a+ O jz 
100-100 0 0 


y=[0 -100 0 ]z. 
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If every state is put at an integrator output and an adder is connected to 
every integrator input, a signal flow graph can always be derived from the 
state-space representation. 


dy d*y dy 
0. eof } i= 200y = 1002 
b) in +i 17a, + Yy r 
c} Insert the coefficients ag = —0.1; a1 = —7; ag = ~107; a3 = ~—200 and 


bs = 100 into Fig. 2.3. 


d) Both are canonical. 


Solution 2.6 


a) States at the outputs of the integrators. We choose: 21 at the output of the 
left integrator, z2 at the output of the right integrator. 


by a= | § rete |* 
el le oo) 


d) Parallel form 
e) a#0andb40 
f) Not completely observable, not observable from any of the outputs as every 


row of C has a zero. 


Solution 2.7 


0 1 0 
ya=|% a b=| 1 | 
c={-3 -8] d=2 


b) The transformation will be carried out with a modal form of A that is not 
in general unambiguous. With T = La ra . | we obtain: 


A70 Appendix A. Solutions to the Exercises 


- | ~2+ 3 0 - | 0.59 
Aa [o7 ay | B=] ony | 


é=[13~-8) 13+8j) |] d=2. 


The eigenvalues of the system are —2 +: j (equal to the diagonal elements 
of A). The system does not change its input-output behavior with the 
transformation from Eq. 2.47 - 2.50. 


c) It is controllable as all elements of b are non-zero, and it is observable as all 
elements of é are non-zero. 


Solution 2.8 


0 0 QO 1 

00 : 1 0 
‘t= To * = 

0 1 --- 0 0 

10 +. 0 0 


b) The proof is easy if one recognises that left multiplication with T~* can be 
interpreted as horizontally mirroring the matrix elements, and right multi- 
plication with T as vertical mirroring. 


Solution 3.1 

1 eis | a a er = 
ta(t) = 7° 2455)t 75° 2—j5)E 4 p-2t 
> $= —2, $23 = ~2 — jo, 53> —2+ 95 
ry(t) : 849 = £7wo, $3.4 = E27 ui9 


Le(t) : $1.2 = tjwo 


Solution 3.2 
a) yes, b) no, c) no, d) no, e) yes, as H(s = 72) = 0 


Solution 3.3 


a) Consistent normalisation for the components: 


fee io. ho ae oe 


: (EK IP 
1A : 1A lV 
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5; it 
>) U2(s) es ROTI 1 
Ui (s) sReri + 3h LC +s? + 4-541 
1 
A s)= 
Gore ges 
1 1 ce 
c) Normalising to 1s and 1V: u(t) = e~* cos(—4t) = ae + ace ’ with 
s; = —~-3+ 94 ss 
: 1 
H(s1) = = —0.25 


0.2(-7~- fA) + 1.2(-3 +94) 41 
H(s,*) = H(s,)* = —0.25 


a) ug(t) = sit(s1)¢ ett sis )* eft! = = fe cos(4t) 
: 4 
De-normalising with ¢ in s and wu in V: ue(t) = ar Vers cos(—t) 

Solution 3.4 
Wheret <0; y(t) =0=4- z(t) 

' 1 
Where#>0: y(t) = [ ef de =—(e" = 1) Adee 

0 5 


Since in the second case there is no 4 to satisfy the condition, x(t) is not an 
eigenfunction of the integrator. 


Solution 4.1 


1 1 ° 1 
a) X(s)= ef eo-otg + feo _ 
a) X(s) 7 Je dt 2. € dt Pal 
0 0 


ee perme” en pretence 
ROC: Re{s} > 0 ROC: Re{s} > 0 


b) x= : gle een at 


Bee 
OO DO 
= 1 [eerma-Z f (~3-8)t gt 
j 72 
= OO oo 
mann Camenmet 


eer jane” 
no ROC no ROC 


A72 Appendix A. Solutions to the Exercises 


oO 
c) X(s)= [errra = el(2-8)T 


T 


Neen pose!” 
ROC:Re{s} > 2 


d) X(s) = [eet orae = [+ 5 : 


¢ 


“ OO 
eo f _ ic - 1 ele-s)t dt 
Q 


0 


Neem eine! 
ROC:Re{s} > 2 


1 ; 
e) X(s)= ? a e **)\e~* dt 
ee 
1 ; 1 / 
(3 2 
= 22 (2—s)t Rte 3(-2~s)}t IY a 

5 Je dt 5 fe d. veer 
mee segs 
Seemann, pomeosemcen/! \cemnnene, sesnennmennet! 


ROC:Re{s} <2  ROC:Re{s} < —2 


Solution 4.2 


Right-sided functions have exponential order, if M,C and T can found such that: 
la(t)| < Me“ for t > T. 


a) yes, e.g. with M=1,C=1,7T=0 
b) yes,e.g. with Wo=7,C =5,T=0 
c) yes, e.g. with M=1,C =5,T=0 
d) yes, e.g. with M=1,C=6,T = 0 
e) no 


f) yes, e.g. with M=1,C =0,7T=0 


Solution 4.3 


First determine M, C, D and T so that |a(t)| < Me fort > T and |x(t)| < Me?! 
for t < —T. The bilateral Laplace transform exists if the region of convergence is 
not empty, ie. if D> C. 


a) M=1,C =0,D=0,T=0 = ROC={} 
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AT3 


b) M=1,.C =0,D = any value, T =0 = ROC :0 < Re{s} 
ec) M=1,C0>0,D<0,7 =0 = ROC = {} 
dh M25 C2. Dao =O = ROC = 7} 


Solution 4.4 


oO 


aq. 4.1: L{a(t}} = X(s) = i a(t)e—** dt 
LAS) + BGO) = [ASH + Bolle a 
90 
A | f(He-' dt +B | g(t)e** dt = AL{ S(O} + BL{g(t)} 
—co OO 
Solution 4.5 
25+3 a. = 
a) F(s) = (@+2)(641) ROC: Re{s} >-1 
b) G(s) = ee. SOC Re{s} > -1 
en (8-+3)(s+)1) oars 
5s? +165 +11 5s +11 


c) F(s)+ G(s) = 


: (s+3)(s+2)(s+1) (s+2)(s+3) 


Solution 4.6 


Hee 4k: -Cilalhh p= X(s) = | a(t)e~** dt 
— OG 
a) subst. t= ¢/ ~ z, es. i => dt=dt' 
dt! 
T-+-00 90 
Atay = ; a(t! — rye 2) Ge! = et | a(t! — eye" dt! 
Pen “00 


ett X(s) = f alt - cet at! = £{a(t' ~ 2)} 


oO 


ROC : Re{s} > 
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b) subst. s = 8’ —a 


aera | w(te oN dt = / e“a(tye ®t dt = L{ex(t)} 
Ts ce 
Solution 4.7 
GL 44:  L{2(t)} = X(s) = i n(t)e~*" dt 


dt 
subst: ¢ = at’, aoe = dt=adt’', a#0 


aoe 9° 
X(s) = | a(at')e**"’ - adt’ = a-sign(a) - / a(at!)e* dt! 
Nats ees! 
eg 08 la a 


3! 
subst: s = ~— 
a 


x (=) 214i father" dt! = |a\L{x(at’)} 


Solution 4.8 
: 1 
I. x(t} = e(t} o—e X(s)=-, Refs} >0 
8 


Il. with the shift theorem: ; 
e “e(l)o- e X(s +a) = ——, Re{s} > Re{-a} 


§+40 
Ill. first scale transform pair I with a = —1 in time: 
-l 
é(—t) o--e | “7 -X(-s)= fe Re{s} < 0 


1 ; 
~e(—-t) o -e —~ = X(s)Re{s} < 0, 
s 
then use the shift theorem: 
1 
—e “e(—t) o—e X(s) = Aare Re{s} < Re{—a} 
IV. see Eq. 4.48 
V. see Eq. 4.49 
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oF 


VI. sin(woyt) e(t) 


@ 


1 ( -) : : : 
= (£{e*e()} — L{emm™ e(}}) = ( <jun 5 ) 
7 { (E)} £4 (t)} j2 \s—jwo 8+ Jjwo 
lg : 
= ae Re{s} > 0 


lI 


aylerunt = oP") e(2) 


(I 


VIL. similar to VI. 


Solution 5.1 


1 
F(s) ,  f F(s)) (ds fr F(s9 co aoe 5 Ong itt 
—— ds = | ——— dy = ——-— - 6-27 e dv 
( 0 


w S— 89 s(v) — 89 \dv 6 fem 
) 


1 


= ani | F (89 + 6e??"") dv = 20j F(so) 
a 
Solution . 2 
Pine Bee 
: Dole ges 
; oe 7 2—28 ee 
ia acne Cheek (s+ 2){s +5) os : 
B = lim [F(s)(s+2 ae 2 
= aE POF BGS] 
é 2—28 
C= lim [F(s)(s +5) = = | 
ae) (SFI(s+2)] 
1 2 | 
Pe) =. 2244-2 
s) s+] oi eae 
b 
f() = [evt—2e-7%! + e-5*] c(t) 
Solution 5.3 
Aj Ag Ag B 
F(s) = -—-—~ 4 +——— 
ee) s+1  (s+1) (s+1)? s+4 
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A3=— = tim, [F(s) (s+ 1)3] = beat 2 
ae 7 Pcs SFG eats tetany 
=—1 
oe 
Grae] 


A= 5 tin , SIF) (s-+1)3] = ae (s+ a= aera) 8 


s=—] 
1 ~-18 
2 (s+43 


ae eee Wis acl 
3s+1 (s+i1)? (s+1)% 38+4 


z 
S 
| 
as 


FQ) = (ebert tet = hee beet 
Ay : Ag Ag B 


gee (s +1)? “ (s+i4)3 s+4 


Equating coefficients is then possible with only two more equations. 


2s—~1= A,(s+1)?(s+4) + Ao(s+1)(s +4) + A3(s+4) + B(s +1) 


8: Q0=A,+B A= -B=-5 
1 
s9: ~1=4A,+449+443;4+B 3 Ag= qi-1- 441 ~4A,~B)=1 
ce) With #'(s) as in a) the equation system . 
0 = A, +B 
2 = 9A;+5Ag+A3+3B 


must be solved. 
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Solution 5.4 


A A 
¢ PF 0 ieee F 
Pa Sere S18 
8+3 Se ae 
= lm [F(s)(e+1+92]=——— == ae 
Se Cay laa ig? Be ae 
s=—1—j 


F(t) = [AeW Ott 4 Ate O-92)4) e(t) = e~* [cos(2t) + sin(2t)] e(t) 


b) Since there are no poles apart from the conjugated complex pair, equating 
coefficients is trivial. 


Rs s+3 _ (s+1)+2 
“ s@ 42845 8242845 (8242841) 44 (841)? 42? 
(s+1) 2 
F(s) = - 
o (s+1)? + 2? * (s+1)? + 2? 
i 
f(Q) = [e~*cos(2t) + e~* sin(2¢)] e(t) 


Solution 5.5 
A Bs C 
Ge ee ee 
(s) st+2 8s? + uy? m 8? + Wy? 


8 —2 
A= lim [F(s)(s+2)| = —~ : pemee cca 
pala Sar 2) 8? + wo? } 2 4+ wo? 


B and C must be determined by equating coefficients: 
(Bs +C)(s+2)+ A(s?+ wo”) = 5s 


Po BPRS = wes 
4+ wy? 
3? : 2C + Aug? =0 => C= aye = wo” ; 
2 4+ wy? 
1 1 8 Wo 
F(s) = =|—2 +2 _ 
rarer s+2 82 + Wo ot Fall 
b 
] ; : 
f(@) = [—2e~*! + 2. cos(wot) + wo sin(wot)] e(t) 


4+ wo" 
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Solution 5.6 


(s+1)(s —2) AB We D E 
F(s)=- = 
(s) s*(s + 2)(s + 3)(s— 1) on ead s+3 s-l 
A=sF(s)|_ =—=+ 
s=0) 6 3 
4 1 
CG. pret : 2 = oe 
fo F(s)| —12 
10 5 
D=(s+3)F(: i 
er?) (|, 36.18 
—2 1 


Vee go 6 


1/3 B -1/3 5/18  —1/6 
PS es | 
(s) sg? ig dete p09 ge 


Determine B by evaluating £'(s) at the zero s = —1. 
1 I i) 1 8 1 2 


Pie ple ae mel 
oh a A eg ee ee 


1/3 2/9 1/3 5/18 1/6 
Then: Fi(s)= 
me (s) <? : 8 s+2 s+3 s~—1 
Inverse transformation using Table 4.1 yields: 


a me | Bec Vie 
t pore t { eis ~2t } st ty on } 
fO=(stt ose 18 ° g© et) 
Solution 5.7 
Pas ee A, Bc Dd 
~ (s+1)?(s+2)(s+3) ~ (s+1)2?  s+1 842° 543 
a 
A= 11°F ais 
err) 5 
ae (s + 2)F(8)| ee 
re ii) ee 
16 
D=(s+ a)F(s)| ==-4 
1 B 3 4 


ree ead ke s+3 


A trick to calculate B is putting some value of s (but not a pole) into F(s). In 
this case F'(s) is evaluated at s = 0. 
71 068 


3.44 
= - == b + : = B 2 
F(0)=14+B+5-3=B+ 55-53 
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1 2, 3 4 
g2 


Then: F(s) = 3 
ren: F(s) (G41 40 eho 3443 


Inverse transformation using Table 4.1 yields: 


f(t) = ((b- 2)e* +3e7% —4e~*) eft) 


Solution 6.1 


1 
= 1: 
H(s) = aC = : 
(8) R+sL+4 sRC+s°LC+1 
s2+28+5 (s—sp)(8— 8p*)’ BPE ie ae 
; 1 : 
With e(t) o—e = we obtain: 
5 A B B* 


1 
Y(s)=—-HA(s)= =: 
) $ (s) 8(8—Sp)(s— 8") 8 | S—S8,  8~ Sy" 


Calculating the partial fraction coefficients: 


5 5 
A coed = eee 
($ ~ 8p)(8 ~ 8p*)|ls=0 Sp Sp* 
5 5 la 
i i ee = = 0.5 + 50.25 = |B e?® 
(3 — Sp*) 8 S=S, (Sp — 8p") 8p o+7 | le 


with |B] = 0.2575 and 0 = 7 + arctan(5) 
Using Table 4.1 for inverse transformation gives the step response 
y(t) = [A+ Beet + Bt e%] (t) 
= [A -+ [Bl evt (eGO+i2t) + e(-JO-J2t))| e(t) 
[A +|Ble' - 2 cos(2t + O)] e(t) 


Solution 6.2 


The gradient of the tangent at u(0) = 1 is ot) =-= 
t=O 


intersection ¢ = T. 


This yields an 
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Solution 6.3 


_ ,-(s-1+f)(s-1-9) 82-2842 
a) H(s) el Ee 9) = K eee second order system 
b) H(s)=K Bom fe second order syster 
@-DG= GID ~ tS ce second order system 
é : s+ ~st+1 
c) H(s)=K (D642) > K oa second order system 
s—4 
d) H(s)=K rece second order system 


Solution 6.4 

s+4s+4_ (s+2)? 

s?+2s+1 ° (s+1)2 

Pole-zero diagram of the transfer function: 


Im{s} 


a) H(s) = 


(2) (2) 
Re{s} 


s* +45 ~ 21 (s —3)(s +7) 


b) Als) = — Reet | 
) ls) s8 +35? +255+75 (s+57)(s —57)(s +3) 


Pole-zero diagrara of the transfer function: 


Im{s} 


Solution 6.5 


From the pole-zero diagram we see that: 
s~-]l . s-1 


= ~ Ka 
x (s+1—5j)(3+1+57)(s + 2) 88 + 48? + 30s + 52 
Ascertainment of K: 


H(s) 
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=1 
H(0)=Ky=+1 3 K=- 


—525 +592 
53 + dg? + 30s + 52 


From H(s) = 


we determine the system differential equation 


dy ak y dx 

— + 4 L §2y = —5 5a 
aE We +- 394 52y 92 mr + 52¢ 
Solution 7.1 


a) The signal is also already known before t = 0, so it is not an initial value 
problem. 


b) It is ¥(s) = H(s)-X(s) with 
1 ; 
A(s) = Bl’ Re{s} > =k 
J : 
X(s) = —~—s + = —2< Re{s} <0 
(s) Pia 40 2< Re{s} <C 
For —1 < Re{s} < 0 it follows 


1 Wo 1 
Y(s —— = +4 - 
is) nea (oer ay) 


ll 


Poe cee 
(s+1)(s* +45)  (s+1)(s +2)? 
A B B* C D E 
Se Hg et 
stl s+juy 8 juo Stl s+2  (s4+2)2 


Finding the partial fraction coefficients: 


ous Wy 
Seams FSET eon 


ga] 1+ we 
wy 


B=(s+ MO) ET aye 


1 —Wo +3 
s? + ui) 


sn Jwy —2wo = 27 ae 2u2 -+ 2 


1 
C= 1 aa ex 
See ees er 
d 1 1 1 
D = — |(s + 2)?_____—. ena sea a 
ds er) esd s=—2 (s+ 1)? Is=-2 ; 
1 
Bag 4.0) eS 
ney (s+ 1)(8 + 2)? ls=~2 : 


Inserting the coefficients gives: 
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wo 1 (-wo + f)(s ~ jwo) + (—wa — j)(s + jwo) 
Y(s) = : : 
(s) l+we s+l1 si (s? + we) (2w% + 2) 5s 
1 1 1 
ee 
s+1l 8s+2 (s+2)? 


= Wy 1 S + 1 t 1 1 1 
l+we \stl stt+ue 3? +02 s+1l s+2 (s+2)2 


Inverse Laplace transformation of Y (s): 


, Wo at 1, 
ytt) = 0 * oF) +L cos SV oe ap eey 
y(t) Tew f (t) + cos(wot) e(—t) sin(wot) e( | + 
+(e~t — e7% — ten?) e(t) 
wo Z _ 
= (1 + 5 Ve aes (t + He | e(t) + 
| 1L+wé 


1 
oe ee cost = tis sin(yt) e(—t) 


Observe that for the inverse Laplace transform, the region of converge is the 
intersection of ROC{H} und ROC{X}, ie., ROC{Y} = {s|- 1 < Re{s} < 
O}. 


Solution 7.2 
a) We wish to find the solution to the homogenous differential equation y(t) + 
3yn(t) = 0. Using the basic approach y,(t) = ce’ yields: 
a-ce@+3-ce% = 0 > a=-3 


yn(t) ee *. Say Ve 


if 


b) The particular solution is the response of the system to 
a(t) = 10 cos(4t) = 5e!#! + 5 e714? = ay (t) + va(t) 
with xy,/2(t)=5e**, fort >0 


Because of linearity: ys (t) = w(t) + ye(t) with yy jo(t) = S {ay j2(t)} 
Using y(t) = Ye", ¥, € C we obtain: 


nt) +3y(t) = x1(t) 
(j443)¥ie = Set 
Y. = e —~=1-e6% wit O= sigtan = a 53° 
34+ 74 3 
Similarly, with yo(t) = Y2e7/** one obtains: 
Y> = : =1-e=-y;f 


ae 3-94 
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Putting in Y; and Yo, 


ys(t) = ef (4t-©) 4. e~J4t—-©) — 2 cos(4t — O) is obtained. 


fo) 
~~ 


Complete solution: — y(t) = yn(t) + ys(t) 
Determining c from the initial conditions: 


y(0) = yo = yn (0) + (0) = ¢ + 2c0s(O) 
Sesame” 


=1.2 

e= yo — 1.2 

Now the complete solution can be given: 

y(t) = (ye + 2cos(4t—O) ~ 1,27) e(t) 
=e een anemone 
internal external part 
part 


Solution 7.3 


: 1 
a) H{s) = 343 
8 

NX s ‘ate 10 ; a 
P) (s) s* +16 ; 

¥(s) = H(s)-X(s) + —yluo ~ 

10 s onl 
= “+ —=[y - 0) 


s+3 8? +165 543 
(using Eq. 7.16) 
c) Partial fraction decomposition: 


A B B* 


HH 8 xX s) =e a 
(s)X(s) rer a nae at ai 
A = [(9+3)H(s)X(s)]|_ = SS =-12 
s=—3 25 
—j4-10 
B = [(s-+j4)H(s)X(. da 
(6+ IOHO)XOI] = GaE_TD 
10 3494 
= — = 1) — = 06 0). 
Go ec ee 


Inverse transformation: 
1 
t) = £L£°-'MH(s)X(s Se 
y(t) {H(s)X(s)} + ret) 
= [Ae + BeI* + B* e** | c(t) + ype e(t) 
eran aeeiioet? 


Conversion to cosines 
=> B and B* in magnitude and phase 
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r 4 : 
B=le?, @= arctan(>) ee 0.37 ce 43° 


y(t) = (ye + 2 cos(4t — 53°) —1.2¢7* )e(t) 
camel \neamemomnmamenmmncasanicn scitnensmenamaccitcomenecee” 
internal external part 
part 


Solution 7.4 
Eq. (7.15): age) + agy{t) = By a(t) + Box(t) 
For unilateral signals that start at t = 0, with (4.34): 


y(t) oe s¥(s) — y(0) 
ylt) o--* ¥(s) 
z(t) oe sX(s)—2x(0) 
a(t) o-—* X{s) 


Putting these pairs into (7.15), yields (7.16) 
ay[sY(s) — y(0)| + ao¥(s) = GilsX(s) — x(O)] + Bo X(s) 
Solution 7.5 
a) Initial conditions from the block diagram: 
y(O—) = 2(0)-(—2)-0.5-4 = —42z9 
y(0+) = y(0—-) + 2(0+)-0.5 +4 = —4z% + 2 


b) Since the initial state has been given, (7.21) is suitable for the solution, and 
the initial conditions are not needed. 


A(s) = mar Re{s} > —1 from the block diagram, direct form H 


+1 
—4 
CS aa 
X(s) = Lfe(t) — te() + &-Ye(t-1)} 
‘ae See ee 
hee at pe . Refs} >0 
; iin Sa tehe ane me ey Azo 
¥(s) = H(s) X(s) + G(s) 20) = 4 sis 4h) s+ 
2 —~ 4% 2 2 —s 
= pF 
stl E eG ) 
1— % 2 2 =—98 2 ate 
= q@— —-+-—e 7 — € 
g+1 $ 8 g+1 


y(t) = [4(1 — ap)em* — 2] e(#) + 2[1 - e")) c(t — 1) 
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Solution 7.6 


a) X(s) = Lf{e(t)—e(t-2)} = ose, eis} 20 
rs goa = Genes 
¥(s) = Hlo)-X(s) + ASE 
fra Ge = 
ae) eas)? ae 


O-@ 


y(t) = [(1—a+ b)em! — (1— 3a 4b) e~*| e(t) - 
=e [e~@-*) ae e  ere) e(t ms 2) 
b) No, because the states are not the same: (7.58) only holds for direct form 


I. The relations (7.56) and (7.57) are different for each choice of state and 
must be determined beforehand. 


Solution 8.1 


The response of and RC low-pass filter to a square pulse (8.7) 


1 To ; t To 

aw lev —tle tT, £>0 ev —-1 ig 
wo=d alte = ent e(t) 

0 otherwise To 
For To — 0 according to L’Hospital: 

et i ie 

TT eas ina! ae es ee 
dim, tt) . () a Ty a e(t) a 1 Tr. r e(t) 


1 
The impulse response (8.4) with a = T is: 
| i 
hth pe é(t) 


Solution 8.2 
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Ras @age=2 
1 _ 7 
d) faa ee? =e? 
Solution 8.3 
a) ga(t) = e(t)~e(¢—1) +e(¢-2) ~~. = $2 (-1)'ett— 
k=0 
a(t) = d1(-1)Fe(t—k) = Yo (-1*d(t — k) 
k=O kazQ 
Xq(t) 
1 


I 


b) a(t) E(t) ; —e(t- 2)—e(¢~4)—--- = e(t)- a2 Yiett — 2k) 


k=l 
t 1 < 
ip(t) = é(t) 5 tet) 5 — Delt — 2k) = 
Koz] 
t ie ¢7 
2 


Solution 8.4 


f(t) = Fe(-t) = 2 et) = ~2) = -a(t 


Appendix A. Solutions to the Exercises 487 


Solution 8.5 
. d 
f(t)= i e{at) 


Substitution: t ae => g Pe 

Substitution: c= at, T= a a ae 

2 f3t ds, 

f (<) = dh Geek?) = a6(z) 

Inverse substitution: f(t) = ad(at) = ia 6(£) = sign(a) - 6(#) 
i 


Solution 8.6 
oO 4 4 
y(t) = JS Fe ~ t)g(c)dzt= Lie t)dt= fle —rye(t— cdr 


case t <0: y(t) = O 
caseO<t<4: yt) = fit-ade=ltr—-—}| ==> 
0 210 2 


case4<t: y(t) 


i 


4 
fit- cdc =4t-8 
0 


Solution 8.7 


wilt) = xo(t) * x3(t) 
Yyo(t) = axy(t) * xo(t) 
ys(t) = x4(t) * x(t) 
ya(t) = xy(t) * x(t) 
ys(t) = w3(t) * xg(t) 
Yo(t) = a5 (t) * a(t) 
y7(t) = wy (t) * Ls (t) 
ys(t) = ag(t) * a5(t) 
yo(t) = wi(t) * x(t) 


Solution 8.8 


The calculation is performed as in Sec. 8.4.3, except that (7) is mirrored and 
shifted. The result is, of course, identical to (8.49). 


A88 
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Solution 8.9 


a) 


cS 
Ewa 


I(s) H 1 LC-s? +1 
di(s) = = = = -—s 
U(s) — Z{s) R+ | REC -s?+L-s+k 
+. +s8sC 
Normalizing to 1V, lmA, lms gives the values R = 1;C = 100; L = 0.1. 
10s? +1 s? +01 
H{s) = = 9 ‘ = 2 
10s¢+Q.is+1  s*+0.01s+0.1 
—0.01s —0.¢ 
H(s) = 1+ ee see ee eee 
; s? + 0.015 +0.1 (s +0))? +0? 
\ 
co) 


A(t) = d(t) - 0.0le(t)e~?** cos wyt 
with o, = 0.005; w, = V0.1 — 0.0052 = 1 


and A= -0.01; B= ca ~1.58-107+ 


al 


or 
h(t) = d(t) + e7*e(t) Ay cos(w yt + y1) 
with A, + 0.01 and yp, ~ —89° 


ROC{H}: Re{s} > —o,. Right-sided since A(t) is the impulse response of 
a real system and must therefore be causal. 


The system response i(t) converges if ROC{/(s)} contains the imaginary 
axis. Since ROC{I(s)} =ROC{H(s)}NROC{U(s}}, ROC{U(s)}} must also 
contain the imaginary axis. So op > 0 and wo can be freely chosen. The 
input signal can have any amplitude, but must decay over time. 


Solution 9.1 


oO ox 
a) Fiz(t)}} = } e Mot e(t) e~ IM! dt = fccieta dt does not converge * 
0 


1 
Lie|ps enmee 5 Resp & 8 
{au(t)} rae {s} 
5 5 5 a5 ee 
b) Fi{a(t)} = pm dt = ser" | = eidw —@ si] . = j2sin(5w) an 
. . | je —5 jus jw 


—5 


= L0si(5w) 
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L{a(t)} = L{e(t +5) —e(t-5)} = —--—— , 8 €C, since a(t) has 
finite duration. 


fo 4) 


1 
Toh ne 2 Ap \ eT IWE Tp me - —jw 0 _ 2 
Fer | alate" dt = ae ; 
‘ ope 1 
L{a(t)} = C{-dH}=>-1 , sel 
4 4 
, 
d) F{x(t)} = | e(—t) eI" dt = | et" dt does not converge * 


1 
L{a(t)} = aa Re{s} <0 


* 


e) F{a(t)} does not converge, see a) 


L£{a(t}} does not converge 


*Calculating the Fourier integral does not provide the solution because the integral 
will not converge. Nevertheless, the Fourier transform does exist in the form of a 
distribution. 

Solution 9.2 

b) and c), since the region of convergence of the Laplace transform contains the 
imaginary axis. (Lying on the border is not sufficient!) 

Solution 9.3 

The Fourier integrals from Exercise 9.1a, d and e do not converge to a function. 
for a) Use the modulation theorem on pair (9.7): 


Fie(t)e 97") = rd(w+wo) + fon 


for d) Use the uae theorem on pair (9.7): 
Fi{e(—t)} = 1d(w) - ie 
for e) Use the principle of duality on pair (9.17): 
F {een} = Id (w+wo). 
The duality prineple is used as follows: 
d(t-—r) oe @ J¥E 
eTdTt oe Qnd(—w — ce) = Qnd(w tz) 


Where z is any constant that can be appropriately replaced in the result by wo. 
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Solution 9.4 


FF { | \ = 2 gut dt: exer / 2 gol eta) ar — 
‘ a 
OO 


t-a t~—a 
—OX 
—é T 
: i eae 1 
= lim / =e IMT) gre fe IM(T+4) de] = 
Ea ee 
ai é 
T T 
. = i ere : : ; : sin(w 7 
= lim e 7" 7 = (© we eee) de= lim ~27.e73** swe) dt= 
e410 im eo T 
T— 90 T+ 20 
€ € 


—~jn forw>0 
=e I08, 0 forw=0 = —jmsign(w)e/** 
jx forw <0 


Solution 9.5 
a) Zeros of si(x) at e= na, n€ Z\ {0}, 


1 1 
here: won: 4a = nT => Wy = Z 


b) Only calculate the area of the triangle in Fig. 9.6: 


oO 


/ x(t) dt = 


oo OG 


) 


‘1-87 =4n 


bol re 


ar aera _ a cn gfe 


ego aw : 
-Bn 440 doe” Bx 120 


Solution 9.6 
a w 
si(107t) o—e jon] rec (so 


] 
si0a(f+T)) o-e —- rect ( ed 


a) 
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\X(ja)! arg{ X(j@)} 
40.1 


—107% 107 -100 -5a 
iY“ 


lf |X| = 0, no phase has been defined; write null. 
b) 


Re{ X(jw)} Im{X(jo)} 
0.1 


~100r | 


Solution 9.7 

b8+5 5(s +1 
Mis) ae i7 (8 ar 2 42 
LAX4(s)} = 5e7* cos(4t)e(t) 
Since the ROC of X1(s) contains the imaginary axis: 
Fo {x1 (t)} = £7-* {a1 (t)}|sagu , 80 21 (t) = 5e~* cos(4t)e(t). 
X2(jw) = si(2w) 


Ze(t) = rect (3) 


X3(gw) = si*(2w) = si(Qw) - si(Qw) 


1 t 1 1 1 4+t for -4<t<0 
z(t) = a (3) * grok (G) er 4—¢ for0O<t<4 
, 0 ~~ otherwise 


with Re{s}>-~1 


4 
Solution 9.8 


a) Conjugate symmetry, ie. real part even, imaginary part odd: 
X(—ju) = X*(jw) 


b) Real part odd, imaginary part even: X(—jw) = —X*(jw) 
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Solution 9.9 
From z(t) = Re{a,(t)} + Re{z,,()} + jIm{x,(t)} + jlm{x,(t)} it follows 
a) 


ya(t) = Re{a,(f)} ~— Refz,(t)} + jlm{z,()} -— jlmf{z,(t)} 


ee 


Yo(jw) = Re{ X,(jw)} — Re{ Xu (gw)} + jlm{Xy(jw)} — jlm{Xy(w)} . 


Both odd parts of X(jyw) change sign; this corresponds to changing the sign 
of the argument: Y,(jw) = X(—jw). 


b) It is sufficient to write down the sign of the four parts. 


li! es, ee See EE ah me yg oe 
[ Om eee 

— oe 

NGO EO en SS a ee Oe 


To produce the desired change of sign (+ — —+-), the sign of the argument 
must be reversed (+ —-+~—) as well forming the complex conjugate (++ ——): 
Yi(gw) = X*(—jw). 


c) 
y(t) = + no 
Yoljw) = + ow. Boe 


Both imaginary parts change sign: Y.(jw) = X*(jw). 


Solution 9.10 
rae Bi: 
y(t) = (z(t) + ms fein eg Ie) 
with [x(t) + m] o—e X(jw) + 27m d(w) it holds that: 


Y (gw) = alk iw —wrp)) — XG(w+wr)) + 2rm(d(w — wr) — dw + wr))| = 


= UX (iw + ur) - XG —wr))] + jnm[ wo +r) — Ho — wr) 
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Solution 9.11 

sin(wrt) oe yr[d(w+wr) - d(w — wr)| 
1 : 

Y (jw) = anh . | * [X (jw) + 2amd(w)| = 


= $1X (ie + wr) — Xv wr))] + jam|[s(w +wr) — ow — wr) 


Solution 9.12 


~ ‘ ] 
a) from sec. 9.2.2: e(t) o—e 1é(w) + — 


Ju 
; . 1 
Duality: 7é(¢) + ee 2Te(—w) 
jt 
P. € at 1 
b) from sec. 9.3: e(t)e7* o—e - 
JUu+ @ 
Duality: at are(—w)e™ 
6g. ae 
t— ja : 


1 
c) from sec. 9.4.4; one jrsign(w) 


Duality: —gmsign(t) oe 27- ae 
—wW 
2 
sign(t) o—e — 
Jue 
Solution 9.13 
7 
7 GT a ~—qwt & — wt ee 
FO} = f Stem =F (|, =p 
00 


To calculate the integral, the rules for derivated delta impulses (8.23) are used. 
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Solution 9.14 


Oo 
% 


dX (jw) _ jut ty : —jet de FS tet) 
Gar = daw | mem ae= | x(t) - (—t)e-2#" dt = F{—tx(t)} 
oC OC 
Solution 9.15 
; dx{t) _ : £ 
a) res = - 1 Tet + T) = 2e(t) + e(t al T)| 
d* x(t) 1 rAa- <rhs 
a = ral (t+T) -— 26(t) + d(t-T)| 
i" ° : i 
@ & @ & 
w*X(qw) = 2 [eer =. Der ab ese) 


Tn doing so, the differentiation theorem in the time-domain (9.86) and the 
transform pair (9.17) are used. 


i 2 = ; ject (=) * rect (=) 


ce) 
1 
@ 


X(jw) = 7 |s (S) Ti (+) = Tsi2 (S) 


Solution 10.1 


a) 20 log 10 = 20 dB 
>) 80 dB 
c) 3 dB 

) -34 dB 
e) 6 dB 


Solution 10.2 


Pout ot Wat 
With == = 773" 


in 


we obtain: 


Vout Vout 
—— = §= 3 dB 
Uy. &8= 18 dB b) rim = V2=3¢ 


a) 


P. ee 
Note: The formula V = 10 log —“* can also be used to calculate the amplification 


WwW 
directly from the power ratio. It gives the sare result as above. 


Solution 10.3 
Magnitude V = 20 log|H(jw)| = 60 dB —20 log Vw? + 100? dB 
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Phase yg = arg{H(jw} = ~ arctan TH 


lk 


| 


Solution 10.4 


j10+1 10 7 
A(G10)| = =1 
ag 10)| /(10)(j10 + 100)| 10-100 
20 log 1077 = —40 dB 


Amplitude sketch: Proceed as with real poles and zeros. (Sec. 10.4.1). 
20 log [2] in in dB 


aB 


-49 /——— ee Ly —- 


0,1 1 10 100 IK wo 


Phase sketch: Proceed as in Sec. 10.4.2. 
arg {H} 


Solution 10.5 
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0.1 i 10 100 ik | 
Solution 10.6 
Y(s) 1 999 1 /s+1000 
a) h(t)o—eH(s) = = py | ete 
ee eae) X(s) aan ( +=) aan ( $41 ) 
20 log |A| 


1 
500 
arg{H} 


|H(0.1)| = 


b) It is: y(t) = |H(jwo)| cos(wot + arg{H(jwo)}), where the magnitude and 
phase of H(jw) can be read from the Bode plot: 
wy = O.01Hz + y(t) = —2cos(wot) 
wo = 1 Hz — y(t) = V2cos(wot + 135°) 
wo = 10 Hz — y(t) =0,2cos(wot + 96°) 
wo = 0.1 MHz - y(t) = —2-107% cos(wot) 


Appendix A. Solutions to the Exercises 497 


Solution 10.7 


20 log || in dB 


100? 
a) |H(j100)| = aa = 1£0 dB 
(j100)? | 


b) |#(j100)| = | = 0.99012 — 0,0864 dB 


(F100 + 10)? 
Deviation from Bode plot: 0.99% 
(j1000)? 
(71000 + 10) 
Deviation from Bode plot: 0,01% 


|A(71000)| = = 0.9999 — 0.00087 dB 


c) 3 dB per pole, so 6 dB in this case. 


Exact calculati | (j10)| | Cae ee 6.0206 dB 

ack Calcwat : Lid! =| |S = - *COO. ; 

xact calculation j10) ‘Gi0 + top 5 

This value is rounded in the Bode plot to 60 dB leading to a deviation of 
0.3433%. 


Solution 10.8 


arg {H,} 


oi 1 10 100 o | 


The amplitude sketches are the same, because |M,| = |]. 


Solution 10.9 
(s+ 1)(s +0.1) — 104. (s+ 0.1) 


a) H(s) = 10*. (s+ 1)(s + 10)(s + 1000) (s + 10)(s + 1000) 
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—— | | 
~1000 = -10— 0,1 Go 


b) Amplitude sketch: 


20 log |A| 
20 dB [oor 
0 dB 
~-20 dB 
ol 1 10 100 1° lo 0 
100 
H(jl00)| = 10*- == 10296 dE 
GIO I) Sogo 


Phase sketch: 


arg{H} 


co 


~45° 


The system has a band-pass behaviour. The maximum amplification is 
10. At w = 1, and at w = 10* it has descended to of the maximum 
(equivalent to 20 dB). 


c) The response to <(t) for £ - oo corresponds to the de voltage gain, ice., 
|H(w = 0)|. The frequency w = 0 is not in the diagram, but for w < 0.1, 
|H| remains constant. The de voltage gains are 0.1 and --20 dB respectively. 
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Solution 10.10 


~Eckfrequenzen 
oa 


— 


ei 
41g .=10 > 


20 log |H| in dB 
smooth 3 dB 


3 |. Dares ace 
~3}- AF ap 
-23 
-43 6 
1 10 100168 2-104 w 
(s+ 10)? 


H(s) = K: 
‘s) s-(s+2-104) 


w = 2-10* is the corner frequency. The magintude of the transfer function for 

w > 2-104 is therefore by a factor of V2 greater than at w = 2-104, 

Tec en pee 
; 108 - 108 

K=V2orK =-V2 

Solution 10.11 


ee pe peo. @ayZ® 
dec dec 


Solution 10.12 


= |K|= 10% = v2 


dB 
Ln - 20 
djn 0 


The amplification increases exponentially at 40 SB when w < 100. Doubling the 


frequency quadruples the amplification, increasing it by 20 log 4 = 12 dB. 


2 a eae ae Se 
V [dB] |-80 | -68 | -56 | -44 


Z| is constant when w >> 100, ie., V = 20 log|H| = 0 dB. 
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Solution 10.13 


2098 means that |H(jw)| grows lincarly with w, ie. doubling the frequency 


(one octave) results in doubling the amplification corresponding to 6 dB. Thus 
9988. = gaB 


dec oct! 
dinely. 4098 21993 and g02B 21828 
Accordingly, 40 dec Lact and 60 ac _ 18 oct: 


Solution 10.14 


20 log |A rp 


= — Be 
10* 10 a 
eee ee 
a ¥( S$) = Dieser tae = 
es (s+)? 
: Lo4 ss ‘ 
|Hrp(0)| = [A - woe Ss lA] = 10° 
10° 
H. - } 
te(s) (s +104)? 
b) 20 log | Hyp 
(20 log A - 20) dB I~ 
01 Dy Wy oO Hes re 8 _ 


S+uwy 


20 log |Hpp| 


md arenas: ‘s 
ane 10 ,=100 i” 18 © 


The amplitude sketch indicates wy = 100, 
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and with (20log|Hyp + Hup|)max = 14 dB, we obtain |A] = =. 


Solution 10.15 


a) In this question only the maximum amplitude can be stated. The values at 
w= 1 and w = 100 belong to c). 
20 log | H| 


26 dB 


-28 dB 
1 10 100 wo 
b) shape of A(s) from 
-- Increase by 202% at w<wo — exactly 1 zero at » = 0. 
doc 
- Decrease by 20 48 for w > wa — denominator degree= numerator 


degree +1 = 2. 
vs 
=> H(s) = >———-; 
(s) s? + 2as +ue 


—~ Q=50% = = af01 

SHG ele K oe “| 2 < 
(710)? + 2a - 710+ 102 20 
=> K=2a:20=0.2-20=4 


~ 20226 dB 


14. 
c) |H(1)| = 7212 dB — 40dB = —28dB 
100-4 
|H (100)| = +52dB — 80dB = —28dB 


1002 
a) 
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co 
x +P ~10 
corner frequencies 


x 7 -Bx-10 
1 Aw ee NG? 
Qo = — => Ne = o_O Tr TS 
Mae op Ons BO. 8 
Aw 
W1 = Wo — 5) = 9.9 
Aw 


Be a aa = 10.1 


Ks 
8? + Qas + wo? 


The condition is a = 0. In the real world this corresponds to the a loss-free 
circuit. 


f) He(s) = 


Solution 11.1 


(= 3 H(t ~ 5k) = Ds 4(g- 4) = uu (2) 


kee k 
Solution 11.2 
Pa ; w 
Insert T = — into (11.12) ein = atLl(at)o—e UL (=) 
a 


- 270 
X (jw) = — (—} 
ast a= 1 a=3 
x(t) x(t) x(t) 
tt te tt " 
" eeenee SYED Se 
-2 0 2 4 t O. Te Be 3 t 0 1 2 t 
(on) XY) (x) Xo) , 
(21), 
0 47 Bs mm 8 Os 
On 20 a Q 2x 4x co -6% 0 6n w 


Solution 11.3 
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a) x(t) = LLL (t = ty) Oo-—-@ X (jw) = Ah (—) e Jwto 


1 
b) tp =0, to = = x(t) real + even => X (jw) real + even 
; 2 
to = ms x(t) real, asymmetrical = X (jw) conjugate symmetry 
1 5 1 rn 
c) to = Z X (gw) = 2m 95 6(w — Qa) eI 4 = Ir Y7 b(w — Qs) eI BH 
“ H 


Re{XYa)} Im{X(o)} 


eee to t oe 

- i 4 - 

a —2xn 0 2x | 6x 8u Ow 
(-2n) 


1 ; 
ty = 3 X (gw) = 2m $7 d(w — 2p) (--1)4 
fh 


XQo) 


Solution 11.4 


2 w ] 1 wT 
Xi(gw) = si (2)+ 2 (5 (¥+5)) 
e 
oO 
2 1 t ed t _ 4 
w(t), == ~= 1 a a fee 
eu(t) x 2 (5) +5 sau (5) 
2 1 
me __ OL ast = — mk 
= =~ > 2k) + — > 7 d(t 2k) e 
: ‘ (-1)' 
w | | 
i 
3 3t a t 
t = mae = oe —3t 
eal) ltt (Ge) +5 w (=) 


1 
= = i 2 a fo) @ aK 
S sft zh +575 mk) ¢ 
: : (-1)! 
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° 

. 

e 

| aE aed 
pe 
— 
~~ 
[rs 
e 
’ . 
° 
° 
e 
e 
— 
_ 
W]e. 
os 

_ 

—_ 
—— 
——E 
| ail 

° 
{ e 
e 


+ / j3wot —j3uot ie ° j2wyol jul) 
5 (efSe0t 4 eHe0t) (cite! — 1240) 


j2 


heey Voy 4 : 
_ a5 (ee aa elwot) ac 7 (e730! fe Hor) = : (e wot 4 cue 


~% for we {-7,-1;1;7} 
= S- Aero mit A, = 4 for p € {—3;3} 
0 otherwise 


b) xp(t) = S- B,,¢1%°* with the followmg Fourter coellicients: 
bb 


—9;11 | —11,9 | otherwise 


oa | Js | 0 
64 64 


ce) &-(t) = s Ce!“ with the following Fourier coefficients: 


fe 
Lb 0 | 22 4,4 | 6; 6 | 8:8 | 10; 10 | —12:12 —14;14 | otherwise 
l 
aie oo ee oe Ie ae oe 


Solution 11.6 


a) In general, the sum of periodic functions is only periodic if cach period is a 
rational proportion of the others. The period of the summed signal ‘/’ is then 
the smallest common multiple of the individual periods, and the fundamental 
frequency of the signal f = + is the largest common divisor of the individual 
fundamental frequencies. 


x(t): fundamental frequency of circuit 3w9, period 1) = oe 


w(t) = sin(wot) cos(V/2wyt) = 0.5 [sin((1 — V2)wot) + sin((1 + V2)wot)] 
-y2 
we 14+V2 


g(t) = x(t) + cos(wot) sin(V/2wot) = sin((1 + V2)wot) 


wi 


T 
~Q => 7, #0 = not periodic 
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Qn 


Period; 75 = —————— 
: (1 + V2) 


Ws 2 _— 
a4(t): not all w, are proportional, e.g., = 2 ¢€Q = not periodic 
wd . 


én(L): Periods of the summands are ae = 4 and aia =6 


= period 715 = 12 
by) XyGw}) = w[d(w — Guy) + d(w + Bw) + dla — wo} + d(w + Yu) 
Xa(gw) = Els(w — (1+ V2)wo) — dw = (1+ V2)w0) 
+6(w — (1 — V2)wy) — 6(w + (1 -- V2)wo)} 


Tv 


X3Qqw) = pee eee ee ae (1+ V2)u0)] 

XaQjw) = = [5(w - wo) — d(w 4 wo) + d(w — V2w9) — dw + V2) 
+5 — s/Swn) — 5(w + VBuy) + 5(w — V4w9) — d(w + V4w) 
+6(w — V5wo) ~— 5(w + V5w)] 

X3(gw) = yn[(w + $) — (w— §)] + ww + 3) + 5(w - 4) 


Solution 11.7 


a) Squaring the sine fimction doubles the fundamental frequency, so it becomes 


wy = = 2wy° 
A. = a / aks (emt nee a) ° ee hed ia dt = 
ais at a a . . 
0 
Lg 
7 : (e2velt-mi — Qe Jvort 4 e—jeo(l te) p) dt = 
1 T T i 
-— | eroll—aitgy 9 | eJwort de + / eae dp 
AT’ | Jo 0 /0 
ee” —_— ees 
=0 for uw A#l =Oforpf~AO0 =O for pp ~-1 
since integration over n periods of e?“°? equals zero 
L = 
1 27 for p=90 2 for = 0 
= Sa T for peal = 4 for fet 
0 otherwise Q) otherwise 


b) The fundamental has frequency wo = 


m3 2 


506 Appendix A. Solutions to the Exercises 


2 0 3 
Ai [ xqePr abe 2: [tt dt +2. fear dlc 
0 


Lt 
-2. freien dt +2- J terdiewt dt =2- fe a fae ee 
3 0 0 


‘0s (2r put Qn pt) ] ? 
2-2 | t cos(2mpt) dt = 4 cos(27 pt) ' Esin(2Qapt) |? 
Jo Oru) Sa 


0 
| (-1)* 1 | az me for 2 ungerade 
NE By fae Mee mie 
(2mm)? (27m)? ‘ otherwise 
Solution 11.8 
Xe) = 20 (=) = = oe (w — 2rk) 
Fourier series: =X (yw) = > A,,e! tou 
1 / 
with A, = on Fl an So O(w — Ink\e IPOH dy = 1 
7 
ee. 


(because of the selective property of the impulse at w = 0) 
au 
With Jo = — =1, X(w) ile 
wo 


Solution 11.9 


a) a&(t) = si(mt)-si(rt) 
ie) 
l 
e 
X (yw) rect (#-) rect (“) 
jw) = rect (— } * rect (— 
sa On On On 
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X(@) X(jo) 
ie 4) 


ere ee 


-2n In 2m -nx | 1 21 = 


The weights of the delta impulses corresponds to the sample values of X (jw) 
at frequencies w = 5p, multiplied by a factor on =F 


1s a loft 


Aut, 
t en . 
ee a ee ee 


Solution 11.10 


x(t) = rect (5) o—# X(w) = 4si(2w) 


i : 
a) x,(t) = rect (+) * 2- S d(t ~ 2k) = 4, because 2 rectangles are placed over 
k 
each other at every point in time. 
p(t) = 4o—e X, (gw) = &rd(w) 
: w 
b) Xp(gw) = 4si(2Qw)- 2111 (=) = = 8si(Qw) }-m 4 (w — 1k) = 876(w), because 
7 


all delta impulses that do not lie at w = 0 0c on at. zeros of the si-function. 


Solution 11.11 


a) Converting (11.14) yields 


; 27 r 20 aT Qn 20 
X (gw) = Xo(Iw) ys (« TR 1) = oe S- s) (» = Fu) Xo (oF), 
a 


be 


where Xo(jw) is the spectrum of one period of x(t). With (11.18) the re- 
quired relationship follows 


9 
X (gw) = 2n S” A, d (~ — FH) 


be 
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— , 2mvet On 
a ce moe (~ ae 1) == X (jw) 
Solution 11.12 
a rT. 
a) Xa(qw) = 2a yo A,,6(w — wopt) = 16(w) — pole gas 5 fais 


U 


b) X,(yw) = eS [(-3)* — 1] 6(w — hwo) 
ki : 


Boe bie 4 1 ee ee 
c) X.(gw) = = a (2h sf yao (2k r 1)w9) = 
4 1 
7 Gee nee) 


Solution 11.13 
h(t) = 5 (ert 7 e It) prt. leo uo sete] c(t) 


2) 2) 
He aEOR eS 2 2 L 
97 |s+01—7 s+0.14+] 
77 D. » R ; TMs 
Pio 
In 
t)= Ayers, wo = ra : period 47 
27 ra 
1 d f it Mo epee SMe 
Ay, = "ua z(t) eJeoH! de = 7 | e Jap ht ay 
_op 7! 
aS ea 75h ah] sa (" 11) 
~~ pom g°-X3 


y(t) = 2 Bu Gees 
: loy@ 
with B,= A, H (agpe) = 98 (Ge) 


Solution 11.14 
For a cyclic convolution to exist, both signals must have the same period: 


T)2 4 50.1% + 1.01 


S(@) . period 4T On - 

: 20 4T=—; T=— 

g(t) : period — wh 2 wo 
wy 


y 
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f(t) = oS Ferre 
Le 
Using the Fourier series for x(t). from Ex. 11.13. 


i(™) f 0 
f(t)=20(t)-1 > Kea si( 2 ae ee 
si(0Q}-1=0 for p=0 


il 
or for p=l 
J 
xe Fuwot = 1 
g(t) = 5° G,e™ 0 ‘ Gi = —- for _— =f 
jb 27 
0 otherwise 
27 27 T\ 1 
a(t = —F.G,, p Pus pet = a gy (=) fe. —e dwot 4. elveat 
y(t) ee i we wy 9 5 | € ) 


be 


4 
= —sin(wol) 
wo 


Solution 11.15 
1 wT | 27 é QTL 
Me = —X(qw a SS, ae = = 
(7w) a (7 )+ uu (5) 5 X (gw) * axIC ) 
Lh 


] ae ; 
= BX ja), wa = 
je 


2n I QW, 
case 1: way = = = = dw, 


Ti Tv 
Xe) 


case 2: wy = = = Quy 
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Xo) 


1.5 Wg 


ara gaeg 
+ ~ —t - Y ~ as 
2 3 4 5 6 Og 


1 


Aliasing in case 3. Critical sampling in case 2. 


Solution 11.16 


Jo. { Wyt 
a) a(t) = ses (“) 


tity, 0 2 
X (gw) = — - 2 rect |) *—oreck | —) = 
. 2m 2k Wy lg Wy wg 


l+— for -wysw=<0 
wg 
= Ww, 
=) 1-~-— ftorO0<w<wy, 
Wy 


0 otherwise 


~Og Wg @ 
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X49) 


Solution 11.17 
t (wl 
a) r(t) = arect (=) o—e R(qw) = aTsi(—) 


Row) = jaTsi(=)I, 


yy J O Ann < lwT| < 27(2n +1) 
arg{R(jw)} = { nm 2n(Q2n-—1) < lwT| <dArn n€ INo 


[Ra(e)| 
aT. 
_ on : 2x an an 
T T 7 
b) 
@) [RaVion)| ®) [Ra(ren)| @) [Ruvo)| 
oe —-na 2m a 
ea x L-4N 
tHIt Lh ae 
watt hatin - f. an ial ee ee a ee 
_2n 2n 4n a _2n an ag _2n an AR Gy 
T FE T TF T 
¢c) periodic repetition of the time-domain signal with: 
20 
a) I, _ B) Tp == Di y) Tp — i 
wg 
(@) rghit) (8) r_() G) . 
-4T VT 4p tf) op a a nee Sar: ae 


& 
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Solution 11.18 


a) X (jw): real o—e x(t): conjugate symmetry 
X (jw): asymmetrical o—e x(t): complex 


b) Bandwidth: Aw = 2w, 


Critical sampling: w,a= Aw > f4=—-2Hn,=—4,T, = = = — 


@ 
C) Wa = dwg 
ave 
/ ji— | ¢—+——_}—_+—-}_4 / s ~ 
-31 3x 70 Ox ay) 
Ser 
M@, , 
Solution 11.19 
a) 
YU@) 
2 4 G 8 10 az) 
(@q wel 07 
b) 
i f 
p Ube 
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When choosing w4, 2 criteria must be satisfied: 


e An image of the spectrum Y(yw) must lie exactly in the baseband. so n-w4 = 
wo, TEIN 
e No aliasing (overlapping images) may occur: 
wy 
WA > Aw = me. 
2.5 


j i wo . 
=> Two possible solutions: wy, = wo andw4 = —. The reconstruction filter must 


remove all images outside of the baseband, and let the baseband pass unchanged. 
HG) 


Solution 11.20 


a) real band-pass signal 
b) 


Yes, because the allocated frequency band is a multiple of the bandwidth, 
so (11.42) is satisfied. 


2w 
f panael 
ti 


baseband 


} @ 
6 
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Appendix A. Solutions to the Exercises 


27 
a3 = Sr 10wy 
3 
X@) 
oo8 a vA 
‘ 
: 5 
~6 (-§ -4 -3 -2 -1 1 3 
w 


Solution 11.21 


a) to d) are real band-pass signals = check (11.42) 
a) NO; Wan = 3.8w9 
b) yes; Waamn = 2Aw = 3wo 
c) yes; Wa,min = 2Aw = 2wo 
d) no; Wasim = 2-20 


e) and f} are complex band-pass signals > critical sampling is always possible. In 


both cases, Wa mn = Aw = 2wo. 


Solution 11.22 


According to Table 11.1, the following holds for critical sampling of real band-pass 


signals: 


2 
We = > =2Aw With wo = 0 and the above condition, (11.44) becomes: 


. ( wt ) 
si | -— 
27 


“( 


Solution 11.23 


a) a(t) 


ca) 


A(gw) 


mm ~ 


with 7 = 


1 7 (=) = ( 
Fy SIN | s ) € 
a) oT 


Tt 
QT 


co 
pay 
or 
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_~ a 


-2 4 1 2 o, 
= 20 kHz 
b) AiO) =~ 
avs ¥ T T O.5tWy, T 
A(t) = Zot (5B) = Tt (7) 
Amplification decays to - AG) = si aC, \= = 0,81=-—1.8 dB 
A(70) 4 


c) The at zero of the aperture function should be at half the sample frequency. 
ie. at = the argument of the si function should be equal to 7° 
wo An 2 2 


3 = 0.2 ms. 
foe See = ee 


Solution 11.24 


ob 
A(t) = rect (=) * [S(t 0.579) } ott ze 5) + o(t —4 5To)| 
0 
‘4 — 2.57; : 
= rect (R °) * [d(t + 2T>) + d(#) + 4( 0) 
% 0 
. 
= s ae 72.57 ow Ae 
A(gw) = si Je fo" . 11 + 2c0s(2Tow)| 
1 g8 1 
ith T= — a 
with T = 54° and To = 6 aaa 


[I (gw)| = To 


Ti 
si (=) - {1+ 2cos(2Tow)| 
| 
The first zero of the si term 1s at 
QT Ww 1 


y= = = = Hz. 
w Th — = Ty 144 Hz, 


. Tv : a 
The cos term has period wy = a -3 fo = 72 Hz. Accordingly, the zeros of the 


0 
term in square brackets are at 24 Hz and 48 Hz. 
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4 


He) 


7 ; 7 0 


24 48 72 144 = 
“27 


Solution 12.1 
in ty 1 ; 
a) @p(t) =e" 4" cos(2rt) = 7 cos(27¢#) 


i\t 
y(t) = () sin(27t) 


fo : 
xL=-In-, Q= 
4° 4 9 
xR) x(t) 
| . I 
1 v2 | 
4 ; ; 
25 1 fr sr I t 
2 er 
We 
kK 3 
1 i oe 
tnlk| = (<5) cos (=e) ( 5 for even k 
: 0 for odd k 


kel 
2 


k I 
1 aaa aids 
£,|k] = (=) sin (5) a5 ( 5) for odd k 


0 for even k 


\t 
b) er(t) = (3) cos(107t) 
y(t) = (3) sin(10at) 
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XR) 
1 1 
F 8 
4 ~ 
a: 1 t - ae 


Solution 12.2 
a) M=-2 ; N=0 
b) Y=mn09 ; Q=0 


c}) H=l09 , Q=x 


d)D=0 ; Q= 7 


e) = Ine = 5 2 Q=4 
f)u=0 | os; n= one 
g) U=0 = sree 
h)x=0 . = nee 


dj), f), g) and h) are the same. 


Solution 12.3 


4 


re GOS TKO dQ 


(er je 


= 
II 
Ss 
n 


| 
3 


x le? Ok—H) JQ 


s+ 


lI 
no 
al 
——— A 3 


| 
a 
oes 


z[pje 2H eI ko dQ 


ct 


“I 
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1 io 
= 4 ,I UR) 
on oa / € dQ 
Kl Se 
_ Zh: Ae 25 for k = tu 
On - Ua 0 otherwise 
a [Kk] - 27 
= off] 
Solution 12.4 
t40 Se a tf ea. OC 
2) ee Gp ae — a A (Sr) Boe aS Bt 3) cos(Nk) + 1 cos(Q - 0) 
k=-—oO k=] 
4 4 4 
= 1+-—-—cosQ — — cos30+ —cas5Q—... 
T 3 on 
re eee 
when k = — 
T 


& 
3 

= 
\| 
=i 
os) 
i 
= 
S 
~~ 
2 
i 
No 

a] 

es 
2. 
SE 
ml 
Ay} 
Se 
BQ] 
E 
Gorn 
bed | oe 
Sa 


© 
. 
4 iT : 
Xa(qw) = 5 2T rect (=) ge ALE (=) es (z € _ 7h) ) 
X (eI) = 


—-20 ~1 25 3 0 20 02 


Note: Even when e!® terms do not appear in the result, the spectrum of a 
series usually is written X (e)®). 


c) Fourier series X(e@) = S A,c/°"" with fundamental period 
fe 
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X (EF )eFTOHO GQ) 


= 
|| 
ae 
5 


2 
= 2-e Hed = — [eH] 2. 
2m JER =a 
-= 
= : jevee _ em = z sin (=) = si (=) 
urn L ET 2 2 


w 
—j2sin ( 5 | 
J MS 
This Fourier series corresponds to the first step of a). 


: 1 
d) A discrete low-pass with cut-off frequency 3 called a haif-band low-pass. 


Solution 12.5 
Hp(e7) <a Sox [k)] (Sie GOR _ Silke’ Ee I0tk 


= So nike FO a ee (cH(2-7)) 
Hp(el*) 
: { Z 
a n Q 


Hp is a high-pass filter. 
Solution 12.6 


a) It is cvident from spectrum X(jw) that X (jw) = 0 for |w| > w,. To sample 


‘ T 
at the nyquist rate, T= — must be chosen. 
w 
9 


aloe) = 35 Xu) + (SP) = OX (a (e- FY) 
Kt 


X,(o) 
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b) According to (12.43), the F-transform of a sampled signal corresponds to 
the F,-transform of the equivalent discrete series for Q = wT’. 


x(el®) 


F Q 
¢) Hy (ce) = Trect ~) for -7 <O< 47 
7 


As the ¥,-transform is 27 periodic, the spectrum of Hy(e/®) and Y¥ (ce) 
are also periodic with 27 
According to: b) Y,(gw) = ¥(e#) with Q = wT 


Hye) 
T 
~20 -1 2n aa) 
~ ne " via 
-20 “Wg Dg 20g “a 
1 N 
d) IIk(jw) = K | ————— 
) TQw) Cesc 
How 0) = K : 1 Fray (eel . 
olw = . = 
: (0, 75a, )% ‘ d 
First spectral image at 1.5w,, .e. 1802 WB = 60 ie damping needed ==> 
N = 3 
Solution 12.7 
Without loss of generality we choose Qg € [—x: 7] 
TT ns 
A 2 Piel So) gag = a f 2a MQ) eF*? dO. = ef h% 
27 , 21 


came LS 
Only one of the delta impulses in the impulse tram falls with the limits of the 
integration. 
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Solution 12.8 


—k- 
a) Soa [ke = Ki] ee -fQk “1 Soa) Je —fQle+e] S— alle 1 eI OK 
ye 


k Bb 


X(e?) 


ee Je ~filke S| alkjeF O-Onik 


k 
Solution 12.9 


FA f lk] * gf a) =D [Dost Jg|k = m= DD Sislalt pee 
= Da fled Doth — Kle —7kKQ es 


Shift theorem 
= F(eJ®) G(ei®) 


Solution 12.10 


is 


1 . re 1 “i OL: 
— Fe? )\@GleI) pei Fe ™MG(el&-™ yay 
20 20 


=r. 


Inverse transform according to (12.16): 


1 oT t W . 
path PY CH EHO) ) doy | pFUk 
oe E I P(e Ge ya eh "dQ 


1 /* mm oe a j(Q—)\ jQk 
—on f Fes [Sle JeF*dQ| dy 
= bia 


Modulation theorem 


Lf" 4 : 1 f" 
= 5 f Be eMalklan = glk] 5 [Flee an 


oS 


= glk] + f ik] 
Solution 13.1 


; ee 
Xy(z) = 273 — 42-2 4 627 Ako gk au 
oe OO 
Xo(z) = Sie ak —k _. en UR+2) 2 (+2) 
ke 


ag ep ee fen aN" | 
eS ee Mere oe 
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522 
0 


10 
S> (-0.8)"Fe-* + zs — (-0.8" - 2°) 


k=-—10 k=6 


> 

w 

o 
II 


i 
Ms 
& 
x 
- 
iMs 


é Ul 
(—0.82)") — 1 toa) -1 er 
eee BE Tp OS < |e] < 1.25 
Solution 13.2 
k 
1 1 
nlbl= (2) ale em)= 7. tt | 
a eA a a 
k 
1 1 | 
ra(t] = - (2) é|—k] o—e Xa(z) = - ry, lel<}- 
a same 1a, 
Ae 0.8 
Xy(z) = ——— ~- —_., 
Neg ee 0e 
X4(z) does not exist because the regions of convergence do not overlap. 
a 1 1 1 
k| = a*elk — | Ke[—k] o—e X5(z) = =: , aclel<r 
talk] = abel I] +a" Reflow Xo(o) = SOF, << 
only exists when a < 1 
Solution 13.3 
a) 
| Xyqlt) = Xp_{t) X3q(1) 
ieee ede a te os 
Ob, 20/37 t ( 51 t 
b) If z,[k] is chosen according to (13.15), then: 
C{rva(t)} = Z{a,[k]}, with z =e? 
5k ies est 
ary [k] = €O**e[k] o—* Xy(2) = gg X1al8) = Sopa 
est 
Xoa(s} = Pr SD da La (t) = Ro, (t): 
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k | Ses : by Rts 
gslk] = ¢€-2* sin (=) -e[k] = 5 iets eneele aa ts e|k] 
1 _ovk _oy\k 
= tas [(ae*)* = (-3e7*)"] ef 
1 2 2, ze? 
Xx s)==— = 
(2) 2] (= es) a pes 
: eve tsl 
X3a(8) ees? 4 e—4 


Solution 13.4 


by Date = 02> a OS = tae 
Lice 
Aga A ee ES ae 
Co 24-3 fare! +14 = _ 25s 


b) Xi(e?@) = 0.5e792 4+ 1 4 0.57% = 1+ cos 


) 

Xy(e?%) = 14 2cosQ 
) 
) 


X3(eI%) = (1+ 2cosQ) e742 
: 4 A 
Xy(e7@ = 1+ —cosQ — — cos32 
T 37 
X[k] y X,(ei2) : 
0,5 pee eas 
al k oo x 
ak ene 
- { "k a x 
alk], | X,(ei2) ai 
$2 k mt eae 
‘ : ' 
x4lA] 1 q X,(ei®) Woe 
4° la ok ad i 


All filters are low-pass filters. 


524 


Solution 13.5 


a) Z{a]k —«)} 


Spectrum: X,,(e?@) = 
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xD x? 


se z[k _ ki] pos Ly alle et") 


Cael 
x+q)* 
Maid) a +2 a (a ( =a 
(aaa) 


bat LG 


Solution 13.7 


- ; at te 


Me eile “ROCs e056 


Then it follows with 


qt 
IND 
Ct 
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linearity: X1(2) = kp X(z), ROC: [z| > 0.5 
shift theorem: Ala eX). ROCs les'O5 


modulation theorem: X3(z) = X (=) » ROC. 


> Fell > 0.5- eRe{a} 


Solution 13.8 

The location of the poles is the deciding factor (see Sec. 13.5). 

1. No poles except at infinity = fimtte, ROC :|z| < co 
2..3. No poles except at the origin => finite, ROC.0< |z| 


=> unfinite, ROC-|z] > 05 


5. H5(z) = ———-_ = finite. ROC :0< |z| 


Solution 13.9 


Because the series are infinite, the inverse transform 1s carried out by splitting 


Rife), 


partial fractions of — 


Xi(z) 6 2 6 
2 se ge +0.5 
2 62 
X10 = 6--- 
(2) & 2+0.5 
zilk] = 66[k] ~ 26[k — 1) — 6(—0.5)*e[k] 
Xo(z) A, 4 3 
- = 2+05 ° (+05)? 
Az 32 
Xo(s) = —4+- $a 
2(=) "EO s eas) 
walk] = —46[k] + (4 — 6k)(—0.5)*e[k] 


Solution 13.10 


. 5 {3 
a) Haz) = (2-Y(P 42+ sl uf: : we) (: 5 ) 
AAS 
b) IT, (2) = = = eee) 
sf +1 
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Solution 13.11 


Ay(z)=A (< - ot) (< - ort) = A(z? + ¥3z2+1) 
hi[k] = Ad[k + 2] + V3Ad[k + 1] + Adjh| 
_ Pte) 


H3(z)=2Hy(z) =  hslk| = A(slk +3] + V30(k + 2] + d[k + 1) 


H(z) halk] = A(6[k + 1] + V35[k] + 6k — 1) 


mtd hbk ma 
ee 2 
-2 -1 0 -1 0 1 3-2 -1 OU 


The difference is a shift and a constant factor 


Solution 13.12 


a) a[k] = e[k] — 2e[k —r ~ 1] + e[k — 2r — 2] 
with the shift eat = rt 4 
X(z) = Z{2[k]} = —— (1 ~ 22 4+ 20° )= satig—p 
b) double zeros at gtl-1 > m= erft, n= 0.1; Qoecert 
‘The single pole at z = 1 is nullified by a zero at z = 1. 


pole with multiplicity of 2r +1 at z= 
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ESDDETIOUN fie) SO EILEIOTAS UO WEN ae PEPER NE chi og A ee 


¢) 
Solution 14.1 

a) LTI 

b) LTI 


c) TI, not L, since S{2x,[k] + x2[k]} a+ x1 [k] + te[k] 7 
S{ari|k]}} + S{x2[k]} = 2a-+a[k] + xa[k| 
d) L, because S{2x,[k] + xo[k]} = a*a,[k] + a*xe[k] = S{x1[k]} + Sf{xa[k]} 
not TI, because S{a[k — N]} a'a|k — N| # 
y[k-N] = a® Naik—N] 


e) LTT 


] 
M>- 
ae 

i 
es 
4K 


f) L, not TI, since S{x[k — N]} 


\| 
$s 
| 
‘ g 
cai 
| 
= 


y|k ~ N] 


g) L, TI, because S{alk — N]} 


I| 
iM 
as 
1 
fas 
l| 


[lat 00 
k—-N k 

yik—-N] = zyl= S> afa-N] 
= OO fi 20 


h) LTII, because difference equations describe LTI systems. 

i) L, not TI, see d) 

j) TI, not 1, because = S{xy[k] + ro[k]} = atlkltrelkl y 
S{xilk]} + S'{x2[k)} 


quilt ube Qv2lk] 
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Solution 14.2 
a) shift-variant, because 
S{x[k — N]} = 2[2(k — N)| 4 y[k — N] = 2[2k — N] 


likewise shift-variant., see a). 


b 


— 


Oo 
er 


The system sets to zero every sample with odd k: 


yk a alk] 7 k even 


0, k odd 
x k =a N 5 k Ve 
S{alk—N]} = r| | even 
. 0, k odd 
alk —N}, k—N even 
y[k — NJ = 
0, k—WN odd 


Example for N = |: shiff-vanant 


Stalk — 1} = 


alk ~-1), k even 


0, & odd 
0, k even 
1 os ae ee 
rik —\j, kt odd 


Example for N = 2: shift-znvariant. 


Salk 2) be a|k — 2}, k even 


0, k odd 
ae afk — 2), k even 
i i 0, k odd 


The system is invariant when shifted by an even number of cycles, but shift- 
ing x(k] by an odd number of cycles does not deliver a shifted version of yA]. 
Note: Systems that are invariant for a certain shift aud its multiples are 
called pertodic shafl-anvariant. 


Solution 14.3 
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b) y[k] =1,-1, 


Solution 14.4 


ylk] =( 1)(k + elk] 


232) 3982 


yk] = alk] ~ y[k — 2] 
y 2] = x[2] — y[0] =1 
y3] = z[3] — y[l] = -6 
y[4] = x[4] — y(2] = 0 
y[5] = x[5] — y[3] = 5 


Solution 14.5 


e Internal part: 


0.5 - 


Yin (0 
Yint | [1 


You'd] = 0.125 


e [external part: 


Yoxt 0} =2 
VYext. 1] =2 
Yext [2] = 2: 
Yext 3] = 2 8 


}=2 


1+0.5 


leave out input signal 


]= 

]= 0.5 o° Yint “ap 0] = are 0. 5 
Yint 2] = = 0.5 Viel l= = 0.25 

|= 


set initial slate to zero 


1+0.5-(L4+3.5) = 4.25 


L4+ 


® Initial condition 


0.5-(14+4.25) = 4.625 


y(0] = Vint [O} =f Yext (0] = 14+2-=3 


Solution 14.6 


529 


a) A unique assignment of initial states is only possible with canonical forms. 


e DF I: Begin with the feedback branch. 
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bo V/ag 


x[k] yk] 


The initial condition is fulfilled by 0.52; [0] + 0.522[0| + 4 0.52[0] = 3, and 
0.52, [0] + 0.52[0] = 1 = ysnt [0]. 


Note: The internal part alone is suflicient to determine the initial states. 


e DF IL as shown in Fig. 14.7 and Fig. 14.9. 


Initial condition: — ying [0] = (s. + bo - =) 20) = 42/0) <= -2[0-=2 
ao 


e DF II: — sce also Fig. 2.5 


x[k] 


ai (O) = O.52/0]) = 2/0) =2 
5) ()-  zfk+1) = 


x[k] + y[k) 
(II) : yk = 2Qalk] + 0.52[k] 
(1) m (I) : y{k] = Qu[k] + 0.5(a[k — 1] + y[k - 1) 


Difference equation: y[k| — 0, 5y[k — 1) = 2x{[k| + 0,5a[k — 1] 


Multiplying the difference equation by 2 yields the coefficients from a). 
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Solution 14.7 
DF I DF Il 


xk] WaT MK] 


The initial states realise yint(0] = y!0] — yext(0] = —1 and yine[1] = 

= yfl] — Yes: [1] = 6. Ouly then will the auxiliary conditions be fulfilled, see 
Exercise 14.4. 

DF: (0) =1, [0] = 6 

PFI: — z2[0] =—1: [0] =6 


Solution 14.8 


|2| > 


|| 


1 
Ye ] IF 
Partial fractions: ¥@) ee, ere 


ta 
LS 
Role 


Solution 14.9 


a) IIR system, because 1; (z) has poles outside the origin, which means that 
the output signal is fed back into the system. 


A(z) az A, A 
—_- = = - - 
z (2 2y)(2 — 28 2-—2p 2-28 
1+; _ 
with 2, = aa! A a J} 
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halk] = [Ask + A*z8*] e[k] = 


Al - legl* ; [emstAt es th 


ae 


k _ 
feral} e-i7k] e[k] = aV/2 (=) COS [Fk cS )| elk 


b) Calculate the first five values of hy[k] and use them for hy{k]: 


a a a 
= halk] =a,a,-,0,--,--,0,... 
2[k| a5 7 qo: 
Ho{(z) = a-(L+27'40.527? — 0.2524 — 0.25275) 
2 tot +4 0.523 — 0.252 —0.25 
i 75 


Solution 14.10 
= 240.527) 224+0.5 


a Hf 2) — 5 ! 
a GS gga son lee 
X(2) = as . (|Z 
()=——: leet 
Yext (2) 22+0.5 85 ; 3 
2 ~ (g-1)(2-05)” 2-1 2-05 
b 
Yext[k] = Sek] — 3-0.5"%e[k] 
b) Yint (2) mee Ae 05 5 2| > 0.5 
e 
b 
Yine [A] = A- 0.5" ¢[k] 
yin [0] = y[0} — Yext{[O] = 3-2 = 4 A= 


c) y[k] = Yext [A] + yins [A] = (5 — 2 - 0.5* Je [A] 


Solution 14.11 


External part: 
1 ge : 


“THe 2841 (4+7)G=7) 


H(z) 
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Z= Rs ie 1 

X@Q=—y. (> 

Yext{2) = ae aes 0.5 , 0250-3) , 0. 
z @tNE+NeE-N 2417 z+; 
] 
ie} 


[ 
= 0.52[k] { 1)* + cos (Fh) sin (5) | 


2 


Internal part: 


Yot(2) = A A* Peak 
(2) pe aay? | 

® 

b 
Yint A) =F [Aj* + A*(—j)*| e[k] 


From Exercise 14.4: yin [0] =—1,  yint [1] = 6 


k=0: A+A*=-1 3 Re{A} =-05 
k=1. gA~gA*=6 => Im{A}=-3 


Yin lk] = cos (S*) + 6 sin (5) e[k] 


complete solution 
ylk] = 0.52[k} - [(—1)* — cos (2 si & 
yk) 5e[k] \ 1) cos (5k) + 11sin sk) | 


Solution 14.12 


0.5 - (—1)* + 0.25 ((—7)* + j*) — 70.25 ((-7)* - 


a) elk] = S> alnibte—n) = STOR — a 
= [kl + 25k — 1] sik 9] + d[k — 1] + 261k — 2] — d[k — 3] 
+6[k — 2] + 25(k — 3] — 6[k — 4] 
= lk] + 35[k — 1] + 26[k — 2] +- 6[k — 3] — 5[k - 4] 
b) clk] = afk+2)+0.8a{k + 1] = 0.8*+e[k +2] +0.8-0.8%t1e[k + 1] 


= 0.8*+26[k + 2] + 0.8*+7e[k + 1] +0.8-0.8*te[k + 1] 


= 0.8°6[k +2] +2-0.8*2e[k 4 1] 
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c[k] 
1,6 
1,28 — 
mi if 
epg ORI 
ee) 123 4 
Solution 14.13 
(a) 114] Op sees 
: a+— ~ g)/— 
—e -6 mi Teer - - ee I I o— 
1 23 4 k 12 3 4 5 678 9 10 k 


Solution 14.14 


(a) » ALK] (b) , ALK] 


Y~@ 
he 


Solution 15.1 
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a) not causal 


ce) causal 


) 
b) causal 
) 
d) causal 


e) not causal, “reacts” to future z[k], when k > Oe.g.. y{1] = [2] 


Solution 15.2 


1 _ . 
a) Hi{ervot) = elwot ok a O—@e Q7d(w = wo) . (—)sign(w)) — —2776(w _ wo) 
Hemet} = F-1{—j2n5(w — wy)} = —eI#ot = ei oot-F) 


A ipa I 
Hsin wot} = rf [emot — e308] = 


b 


ents) 


co) 
e 


2n[5(w — wy) — 6(w + wo) - (—gsign(w)) = —1[d(w — wo) + 6(w + w)] 


H {sin wot} = -- coSwyt = sin (wot — =) 


io) 
ae 


Ls a | 
H{cos wot} = [ero 4 eo Ivot) - 
4 t 


1 - Z ‘ - 
ae 27 16(w — wg) + d(w + wo) (—gsign(w)) = —37[5(w — wo) — 6(w + w)| 


. “ie 
FHicos wot} = sin wet = cos (wot — 5) 


d) H{cos 2wyt}o—e — 7n[6(w — 2wo) ~ d(w + 2w)] 
H{cos Quit} = sin 2u9t = cos (2w0t — “) 


In all cases, the Hilbert transform causes a phase shift m the time-domain by - 


a 


Solution 15.3 


A) 1) = - o—e H(qw) = —ysign(w) 


1 jw) 40 - w > 0 

F amas, w ‘ nay — ;-.— 
e= ‘ 0 otherwise arg{ H(jw)} = D w=0 
3 w<O 


536 


Cc 


— 


~~ 


~~ 
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|HGjon)| arg{H(m)} 
1 


The magnitude of X(jw) stays unchanged until w = 
0 w= 

Xn (gw)| = 

Xn (ow) { |X (jw)! otherwise 

for the argument: 


arg{X (gw)} — = wee 
arg{X_(gw)} = 0 = w =0 
arg{X (gw)} + 7 wx 0 


€ 


y(t) ist real, since both x(t) and h(t) are real. Using the symmetry scheme 
9.61 and Y (jw) = —ysign(w)X (jw), we obtain: 


1h, ae 
Lg.real md Kg eat => Youmag @- 8 Yu real 
und 
Zureat® © Xy uunag > Fy,real @——° Yq real 
The even part of x(t) becomes odd by the Hilbert transform and vice versa. 


Since 1s y(t) real, Y (gw) has conjugate symmetry, according to (9.94): 


f ae 1 p= . 
[ una - xf X(gw)¥ (—jw) da = 5— f  X(gw)¥"(gw) 
Qn re Ie 
as . _ 
= On | X (gu) 7sign(w).X™ (gw) dw 


=i / |X (pw) |*sign(w) dw = 0, 
20 


X (yw) = X*(—jw), and therefore |X (jw)|? is an even function. The Hilbert 
transform of a real signal creates an orthogonal signal. 


With the result from Exercise 15.2 and sign(0) = 0, we obtain: 


oo 


Fie e(t)} = pe a, sIn(wyVt) -- b, cos(wort)] 


vol 


qn 
Ww 
“I 
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Solution 15.4 


1 | 1 1 
a) 2(t) = —-+——-cosw,t-- 
x) x(t) eg Ota 
ie 
e 
1 3 1 | , 
X(jw) = = [-gmsign()] — 4 - J -n[6(w — wy) + 5(0 + uy)] « [-amsign(w)] 


= —ysign(w) + ; [sign(w — wy) + sign(w + wy)] 


S) -ar Ses 
( “Est 


c) X.(jw) =0 for w < 0, causal 
d) Xa(qw) = X(qw) + 9X (gw) = X (qu) (1 + j[-ysign(w)]) 
2X(jw) for w>0O 
= X(gw)(1 + sign(w)) = X(gw) for w=0 
0 for w<Q 
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Solution 15.5 


#(t) = H{a(t)} 


ie) 
| 
e 


X(ju) = —ysign(w):X(Qw) => |X(jqw)| =|X(qw)| Vo £0 
According to Parseval, signals with the same magnitude spectrum have the same 
energy. The exception at w = 0 does not make any difference after integration. 


Solution 15.6 


Kola) = [1 44f—asionly NIX (a) 
Pa ils  aceiaAReTy ot) OR aie = aid Coca 7 A Pelana 
e 
| 
roy 
1 
go(t) = a2i(t)+3-21(t)* = x1(t) + jH{x1(t)} 
Tt 


b) The Fourier transform of a real function 1s even. Knowing that, and using 
Parseval’s equation, the energy of 2, (t) and x(t) be calculated as follows: 


Ky — / jc, (t) \? di = = =| (X1(w)|? du — an | PA w)|? dw 
1 
15) f wana 2 / [Xo(w)|? dw 
I f : 2 l 7 5 
= 5 i \(1 + sign(w))(X1(w))| ds = =~ f A|X(w) dua 
<0 0 
ae 
= = f |X) dw = 28) 
c) Ey = / jaro(t)|° dt = / ly (t) + JH {ay (t)}|? dt 


[oe] 


i xy (t)? + Hf (u)}? dt 


oO 


| 
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= | ni(oPa+ f |H{xi(t)}|? dt = 2h, 
x —oo 
Ey Ey 


Solution 15.7 


a) For a causal system : 
1 1 
9 = ——Pljw)*x-—- = — Plhww 
Q(jw) = ~~ P(gw) * — = —H{PGw)} 
‘This yiclds: 
A (je) P(jw) — p= P(w) * - 
WwW — uw — o— dé * _ 
Jj J Je JW) oe 


| 
oO 


y : és i * re Ne 
h(t) = p(t)—j2p(t) Fh ‘et = p(t) + p(t)F- ea 
= p(t)+p(t)sign(t) = 2p 
i u : wW Wy a Wyl 
In particular, P(jw) = aa. “rect (=) * rect (=) e—o a (#) = p(t) 


yields: A(t) = #9 2 (=) é(t) 


bo 
Fae 
+ 
~— 
® 
~ 
o 
ae 


A 


b) Q(jw) = -H{P(gw)} = 2. | Pon) diy 
x fw-n 
Pow) = | + “| ie(w + Wy) — e(w)] + [ - ma [e(w) — e(w — wg)] 
o fy, a | ia)! 
tof [E+ apy ler +9) — en) 
OG aS af ie eed 
(J -, wen dn 
LF [b= 2] elm) - (yw) 
= WwW -- 7 
QU) = -—— Jeon +) In real + (w ~ wy) n| = | 
ruee ww 
c) Hw) = P(gw) +3Q(qw) 


nt) = ptt) +yq(t) 
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Since P(jw) 1s real and even, the symmetry properties (9.61) show that: 

p(t) is real and even 

q(t) is maginary and odd 

Q(jw) is real and odd 

Solution 15.8 
1 : 
a) sar(t) = s(t) cos(wot) o— © Syg (gw) = 5,804) * T[d(w — wa) + d(w + wa)] 

oT 


1S yo) 


J 
OG ay- Mg Oo COg+ Dey w 


b) S(yw) 2+wWyg = 20-8 kHz 
bandwidth Sjr(yw) 
bandwidth S(jw) 


rf 


Sy (gw)* 2+ 2+ ws = 20-16 kHz => 


c)  sem(t) = s(t) cos(wot) -+ s(t) * —| sin(wot) 
7 
Sem(gw) = == (8) « T[6(w — wo) + d(w + wo)]+ 


+[S(s0) + (—a)sign(w)] * £[8(w — wo) — dw + wo)]} 

= ; {S(g(w — wo)) + S(a(w + wo}) + S(g(w + wo)) - sign(w + we)— 
—S(j(w — wo))sign(w — wo) } 

al 


Pe 79 (MQ- Og MQ we w 


d) Sw) 2-wy = 20-8 kHz 
bandwidth Szu(qw) _ 
bandwidth S(jw) 


Sem(gw):2-wg = 20 8 kHz 
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Solution 16.1 


a) | |A(t)| dt = fe O11) sin(Sxt)| dt < fem 1d = a ee = 
—oo 0 0 j 


=10 = = stable 


b) with Table 4.1 and the modulation theorem of the Laplace transform, we 
obtain 
57 57 
FI(s) == 5 = oo S85 = —0,1 £ 
(s) (s+0.1)?+ (5m)? (8 — 8p) (8 — s*) [ d 


Poles lie in the left half-plane = stable 


Solution 16.2 


[oe] 
Bounded mput: oa |[k]| <4 , My <0 
k=-—20 


Sufficient for bounded output: 


jy[A}| = Ss a|K|hik — K]) < » jax] | -|h[k — K]| < 
<M, S° Alk—#]<MiM, . My <0 

bi ; h*[—k] 
Necessary condition: choose input signal: a:[k] = In| A 

u—k 
x fae) 
= yO} = S > afeja[-nl= S© [nfl 
Solution 16.3 
can 76 — 
a) ¥(z) = X(z)~a®z°X(z) = Ai(z) = —; 


~ 


< 00 


Region of convergence: 0 < 
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H(z) is stable for all a. 


1 1 ro 
b) H(z) H(z) =1 => Ay(z)= Hy(2 mG ao 
(2 2° —4@ 


Possible regions of convergence: 


1. |z| < al = H(z) 1s not causal and stable for Jal > 1, because the 
poles of a left-sided sequence have to lie outside of the unit circle. 


2. jz] > fal = H(z) is causal and stable for |a| < 1. 


Solution 16.4 


1 wd 
a) A(z) = ss = = 
Le ae z—s2th 
by) a) 
‘ TIm{z} 
v3 
4 
Qi. Re{z} 
iL 1 
v3{ 4 
-81 x 
Zeros 24/2 > 0 
Poles: 21/2 = ¢(1 4 9¥V3); |a1jo] = 3 < 1 => stable. 
3) 1. H(z = 1) is finite 
3624 3,4 7 
Os fs Ey + : = gee Numerator is a Hurwitz poly- 
2 A wait (s— 1)? 
geal 


nomual => stable. 
c) All zeros inside the unit sample are => minimum phase. 


d) Yes, evident from the difference equation. 


Solution 16.5 


The internal part with order 2 can be split into partial fractions: 
N 


N 
A,z : 
Vint (4) = ~ e—o Vint [K| = 2 A,2¥ ¢[k] 
a= 


2=1 


& ar 


The series ne decays where k — oo, if |z;| <1, ie., if the pole lies within the unit 
circle. 
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Solution 16.6 


a) Denominator polynomial N(s) = —2.5{s? + 4.58? 4 8s7 + 7s + 2] 
all coeflicients are positive and exist = possibly stable. 
Hurwitz test: 
A, =a, =45>0 
Ag = aa, —ag3 = 1.5-8-T>O0 
Ay = a) 4903 — a204 — ax = 162.5 >0 


Ag = 41020304 — ata? — azaq = 325 > 0 


= N(s) is a Hurwitz polynomial. so /7(s) 18 stable. 
H(s) does not have minimum phase, because zeros lie in the right half-plane. 


b) Not all coefficients m N(s) = s* — 4.583 + 8s? — 7s + 2 are positive = so it 
cannot be a Hurwitz polvnomial, and H(s) is not stable. 


H(s) does not have minimum phase, because zeros lie in the right half-plane. 


c) Not. all coefficients in N(s) = s? + s + 2 are positive since there is no term 
with s? + not a Hurwitz polynomial, so H(s) is not stable. 


H(s) has minimum phase, because no zeros lie in the right half-plane. 


Solution 16.7 


Since the transform is the same in both directions: 
e Inside the unit circle of the z-plane — left half of the s-plane 
e left half of the z-plane -> mside the unit circle of the der s-plane 
e Intersection = left half of the unit circle on the z-plane —> 
Intersection = left half of the unit circle on the s-plane. 
Solution 16.8 


a) Hy(s) = 2Vo(s? + 1) 
E(s) (sy) P - : 
1+ E(s)G(s) 1+ Ho(s) a 1+ 2Vo(s? oh: 1) _ QV) 82 +My 41 


A(sy= 


b) H(s) is unstable, because the denominator of H(s) is not a Hurwitz polyno- 
mial. 


: cia a cesiead 1 
Poles: sy9 = -+9,/14+ 3 
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c) No, denommator polynomial is not a Hurwitz polynomial for all Vy > 0. 


d) When s = jw: gw = + 9,/1+ 54 > w= +6 


Vo 
e) U(jw) = * [dw — 6) — d(w + 6)] 
Rw) = HoQgw)UQqw) = -UGw) 
i 
r(t) = —~sin(6t) = —u(¢) 


Solution 16.9 


a) H(s) has poles at s = +7 => unstable 


A(s) 1 


by la) 1_-H(s)Ks s?+1—Ks 


c) s* ~ Ks +1 must be a Hurwitz polynomial > K < 0 


d) I,(s) ~  (g— Eyipai 5 aS 1 ie 
e 
l 
3G 
hy(t) = fe?! sin(at)e(t) 
[im (t)| dt = [a af eee er sf Sle G6 
OO 


h,(t) is integrable == stable 


Solution 16.10 


a) 


; 


Unstable, because of poles in the right half-plane 


F(s) 8 
1+K-F(s) 2 +(K—2)5+5 


b) G(s) = K; H(s) = 
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points for root locus: A =0: Sp = 1+ 92 
kK=2 ay = tg/b 
K=4: 8) = —1L4 92 
double pole K =2+2V5: So V5 
Koo: Spi 7 —OO > Sp. 7 O- 


Stablisation succeeds if 2< WK < oxo. 


Solution 16.11 


F(s) i 
a) II(s) = - 
ore) 14+K-F(s) s?9-2s45+K 


points for root locus: A’ — —00 . 81 > —00 3 892 — 90 


K=-—5: 8p) =0, Sp, = 2 
A=-4: Spl = Sp2 =] 
K =0, Sp = 1492 


K=5: 8) = 14+ 4393 
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Cannot be stabilised because both poles do not lie in the left half-plane for 
any k. 


1 


b) I(s) = ——— 


824+ (hK —2)s+5 
IJurwitz: necessary + suflicient that all coefficients are positive 
=> stabilisation for K > 2 (compare Exercise 16.10) 


Solution 17.1 


a) The linear ensemble mean E{x(t)} is equal to the linear time-average x;(t) 


= 


of cach sample function. 


Ensembles 1 and 2: Yes 

Ensemble 3: No, because the time-averages are different. (x;(t) 4 x;(t), 74 
j) 

Ensemble 4. Yes 


Ensemble 5: No, because the ensemble mean is time-dependent, E{z(t)} # 
constant. 


The ensemble mean squared E{2?(t)} 1s equal to the time-average squared 
xi7(t) for each sample function. 


Ensemble 1: Yes 

Ensemble 2: No, because the ensemble mean squared E{:r?(£)} 1s time- 
dependent. 7 

Ensemble 3: No, because the time-averages squared x;7(t) of each sample 
function are different. 

Ensemble 4: No, in this case the time-averages squared x;(t) are also dif 
ferent. The sample functions have the same mean, but different amplitudes 
and therefore different mean powers 2;?(t). 

Ensemble 5: no, because the cnscmble mean squared E{x?(¢)} is time- 
dependent. 


Solution 17.2 


a) According to (17.14) und (17.15), for weak stationary random processes: 


— pi, (t) = constant: except at 5, 
— o,°(t) = constant: except at 2, 


— the ACF ¢,,(t,t—7) does not depend on t: except at I. 


Only ensembles 3 and 4 can belong to weak stationary processes. 


b) For weak ergodic processes: 
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— E{x(t)} = 2,(t), because of (17.21). Applies to ensembles 1, 2 and 4, 
see Exercise 17.1a. 

— E{x(t,) x(lg)} = xj (ti) -ai(t2), because of (17.20). In Exercise 17.1b 
the special case ty = fo is investigated. The condition only applies 
to ensemble 1. Because this random process is not weak stationary, 
however, it cannot be weak ergodic. 


=> none of the random processes are weak ergodic. 


Solution 17.3 


a) 


b) 


Linear time-average 2; (t) = 0, because there is no de component. 

The expected value at a certain point to, E{x(to)}, is spread across many 
points of the CD signal (at most by as many samples as there are on the CD), 
because im our experiment, cach sample function comes from a random time. 
Since music signals in general do not have de components, E{x(t)} = 0. 


With first order expected values we can only discuss the condition for sta- 
tionarity given in (17.14): In a) we acertained that ju, = E{x(l)} = constant. 
With the same notation we can assume Efx?(t)} = constant, because it is 
determined from many values of the output signal «:?(t). 

=> the random process could be stationary. 


For ergodicity, the first and second order ensemble means musi agree with the 
corresponding time-averages of any sample function, e.g., E{x?(t)} = xi? (t). 
This does not apply because to form the time-average squared «;?(¢) only a 
ten second section of the CD is considered, which for different sample func- 
tions 2, is taken from different points on the CD The averages are generally 
different, following to the loudness of the music. 

=> the random process is not, ergodic. 


Solution 17.4 


bly = bey + fry = 2 

Ey? (t)} = E{ (a(t) + aa(t))?} = Ef{et(t)} + 2 E{ar(0)x2(t)} +2 {a3 (1)} =7 
" Ftaa(Oaa(O} 

oy = EfyP(t)} — yy = 3 =0 


Solution 17.5 

Oy = E{ (v(t) — wo(t))?} = Ef [a(t) + y(t) — (welt) + Wy (€))/?} 
Since y(t) is deterministic, p(t) = y(t 7 and therefore: 

o? = Bf(2(t) — pia(t))?} = 02 = 10 


Adding a deterministic signal docs not change the variance. 
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Solution 17.6 


a) fly(t) =1+h 
OF (l) = EA (y(t) — Hy)?} = Eflel) + K — (1+ K))?} = BL (2(t) ~ pe)*} = 


= a —aA8 

Efy?(t)} = oot y2= Ke +2K 45 
y(t) =1L+K 

Ergodic. 


=> 
oC 
— 


ft, (t) = 1+ sin(l) # constant. > not stationary 
o2(t) = E{(a(t) + sin(t) — 1 — sin(t))?} = 02 =4 
P{y(t)) = 5+ 2sm(e) + sin?(t) 

yilt) = | 


Not ergodic because it is nol stationary. 


oO 
Ww 


jty(t) = 1+ e(t) 4 constant > not stationary 
a7(t) = 02. see b) 


Efy?(t)} =4+ (1 +e(t))? =5 + 3e(t) 


yi(t) = 15 
Not ergodic. 
d) py(t) = 5e(t) A constant > not stationary 
ai(t) = 25e(t) o2 = 100e(t) 
E{y?(t)} = 125e(¢) 
yi(t) = 2.5 


Not ergodic. 


Solution 17.7 

jer(t) = a(t) 

E{x2(t)} = 22(t) =e? *e(t) 

o2(t) = E{a?(t)} — we(t) = 2°(t) — 2° (t) =0 


a(t) = ja a7 
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Solution 17.8 


a) Ergodic, because the properties of a die do not change with time. 
fly = 3.5 (see Example 17.1) 
14+4+94+164254+36 91 


W{x2lk]} = = 15.17 
{?[k} : == 15 
2 2 2 _ 35 ‘ 
ao. = E{x*[k]} — we = — = 2.92 
b) Likewise ergodic. because the properties of a die do not change with time. 
[My = 15.17 
6 
ae 1 
Uf pie fez yt an ’ 
Bia [k]} = & Sok Hang 
k=1 
a2 = 149.14 


Solution 17.9 


To calculate the time-averages, we use the results from Ex. 17.8a), where z(t) 1s 
f 7 . y c 
the number on a “normal” die, 4. = 4 und Efx?(1)} = 4 


2 6 
— 64 2p, 13 
ul = 
ih 5. 199 
y.7 [|= 3 (2 - Ea? [k]} + 6?) = <s 


The ensemble means of y[k| for k A 3N, N € Z, agree with those of a[k] from 
Exercise 17.8a). For k = 3N, N € Z. 


piylk) = 6 

E{y"[k]} = 36 

Oy? [k] = Ely? [k]} — uy? = 0 

Neither stationary nor ergodic, because the ensemble means are uot constant. 
Solution 17.10 

Poole) = Hleli+ ce") = [K+ KA} HA? 

Solution 17.11 


As every sample function has a period of 10s, the ACP yy(to.to + T) 18 also 
period in z with a period of 10s. A good approximation is given by gin(fy.to + 
z), independent of time fg. ‘The justification is similar to Exercise 17.3: The 
correlation properties of a sigal mixture [rom the whole CD are virtually unchanged 
within 10s: 


Pua (to. to + 108) = Yox(to,to) = E{x?(lo)} © constant. 
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Solution 17.12 
a) E{(x(t) + y(0))2} = F{a2(e) + 22()y(e) + yl) = 
= F{a?(t)} + 2Bfa(y()} + BPO} = E{22(O} + Bly} 
To satisfy the condition, E{a(t)y(t)} = 0. 


g, 


‘The special case of z = 0 in (17.48), 9, = {x(t + c)y(t)} (17.46) and 
[lg = E4x(t)} yield: 
E{a(t)y(t)} = £{a(t)} - E{y(o} 


Either E{a(t)} or #{y(£)}, or both expected expected values must be zero 
(at least onc of the random signal must have zero mean). 


a 
aed 


Solution 17.13 


With deterministic signal, the quantities in question must be calculated with time- 
averages, because the ensemble means correspond to the signal itself. 


a ioe ee 
Power: lim — | d?(t)dl = d?(t 
ower: jim sr 3 (t) (t) 
a _— 
de component: lim — | d(t)dt = d(t) 
Toco 2T —-T 


Effective value: 1/ d?(t) 


Power of the ac component: (d(l) — d(t))? 


Solution 17.14 


Forming the time-average according to (17.18) 1s linear. With » = d(t), therefore: 
(d(t) — 2)? = a?(t) = Qud() + p? = P(t) ~ Qud(t) + uw? = P(t) — 


see derivation of (17.8) 


Solution 17.15 
Pry(T) = E{(x(t) — Lex) (y(t = = Ley) } = 

= E{x(t) y(t — ct} — pe Ety(t — 7) } — My E{a(t)} + Matty = Pry(Z) — Melty 
Solution 17.16 
For 7 — oo any chosen random processes are generally uncorrelated: 

_ 42° +10 
Gay & = 00) = ally py = lim — pS 
Tw + 
Pye Z) = Pay(—T) = Pa, (C), da Pye (z) is even. 
‘Taking the solution of Ex. 17.15 we obtain: 
4c* +10 ;j 6 


Wie (Z) _ Pya(T) ~ bea fy = ae = 1+ = = Way(z)- 
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Solution 17.17 


a) By = Puol(t > oo) = 
[ty = 0, because the delay does not change the dc component. 
Puv(T) = E{u(t)u(t — z)} mz E{v(t = 10)v(t = t)} = Yuv(t — 10) = el eal 
PuulT) = Puv(—Z) = e7|- t-10| = en! 7+10| 
PuulZ) = Por(z), because a delay does not change the correlation properties 


of a stationary random process. 


b) Yua(z) = e!4l = (re 4+ e(—z)e* 
oO 


| 
e 


1 1 2 
P— VU 7) w) = 


jee foe 1 oP 
(with (9.12) and Table 4.1) 


; F . —s10~ 2 
®uy(qw) = engie $,,(7w) =e i180 we +] 


Dou Ai VS of 10 
Sd aa rCE 


a 
aes 


®,,,(gw): real + even, since Yry(z) real + even 
®y.(gw) and ®,,,(jw): conjugate symmetry. 
v(t) real, since ACF real + even. 


Solution 17.18 
Pua (0) = E{x?[k]} = 6° see Ex. 17.8. 


Since the numbers of dice are uncorrelated with different time k, Yo, [k& #0] = 


ae = L 
49 35 
Peek] = ig F Tp 


Bh a. 
Wooo [A] = Pra [K] — be” = 72° [K\] 
02 =F. iF + soln} =F ( ; ) = 


Solution 17.19 


Pe a alae 
Ua 4 ~ 4 


+? +1417 9 3 
2 2 2 

T -—E a k -—pPer = = = 
a {e"lk]} — Hs 16 16 


Poole - 0) = [ly”, because the outcome of a dic does not correlate to different 
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15 
Pay|K] = Pyx lk] = [lefty = —, because the two processes are uncorrelated. 


times. 
8) 3. 
Paa[K] = 16 of 76°" 
benlk] = > dR] 
. 16 
fe 9 Q 3 
’,.,.(e%) = — LL 
Bee) = ae ( = | a6 
Solution 17.20 
i 5 
9 5 
oy = Efy"|k]} — py i 
25 8 
Pyy (Al = yy a ra 
8 
Solution 17.21 
1 oS 
Power: FP{xr7(t)} = — 
oe BO} = 
DO 


ACF yo (qw) = Arect e eae a) 


e 
| 


7 1 
Prx (7) = =si?(zc) 
Tv 


Solution 18.1 


2 (gw)dy = 


yim 


~ 


4 


a) Pary( Z) 


Pyy(Z) 


I 


Ejc(t+ cy" ()} = Ef{at + c)(C* + 2*(t))} 
C™ ps + Efa(t + c)a*(t)} = C* ps + eer (Z) 


Ely(t + cyy"(t)} = E{(C + alt + 2) (C* + 2" (t))} = 


je? +O pee + Cup + Pox(t) = 
Ic? +2 Re{C* flay + Yaa (T) 


b) We consider z(t) and C' as signals of the same kind. 


Pry (TZ) 
Pyy(T) 


PaalT) + Prc(Z) = Pua (t) + E{z(t + 2)C*} = Yer (Tt) + Ma C* 


Pare t) ao Peo(Tt) + Pca z) + epoco(z) = 
Pua (z) st Tee Cass + Cue + Ic? = 
Gar(Z) + 2Re{us,C*} + (CP 


ort 
ort 
we 
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Solution 18.2 
a) With (18.8): Que(z) = |Al?ver(z) 
b) With (18.12): gyy(z) = Yay (z) + 2Re{u,B*} + BP = 
= |A)?yera(z) +2 Re{ Ap, B*} + |B)? 
c) With (18.7): Gev(z) = A*pre(7) 


Solution 18.3 
a) Puy(t) = Blalt+ c)y*(z)} = 
= E{z(t + c)(A*2*(t) + B*)} = 
= A*Rla(t-+ cla*(t)} + B*Efa(t + c)} = 
= A*pun(t) + B* po: 


b) No, because we arc not considering an LTT system. Adding a constant makes 
the system non-linear (see Ch. 1). 


Solution 18.4 
a) Pww(T) a = E{ Ww (t +t ett = = 
= E{A(B + . - T))(A*(B* + u*(t)}} = 
= |A/? [Bl + B* E{u(t + c)} +B E{u* (t)} +E {ult - zyu*(t)}| = 
——S ee’ ——— 


=0 =0 


= JAB? + Puu(z)] 
b) Gow(z) = Efu(t + c)w*(t)} = 
= E{v{t+ z} A* a +u*(t))} = 
= A*B* E{v(t + z)} +A*Ef{o(t + c)u*(t)} = 
Se ee 


=0 
= A* Du ( Z) 


c) With (17.54): Pu uf t) = = t) = 7 Ag l=) 


d) Pum (eT) == E{utt 4 z)w* (t)} = 

E{u(t + r)A*(B* + ux (t))} = 

= A*B* E{u(t + 7)} +A*E{u(t + z)u*(t)} = 
—— 


il 


a A* Pun T) 7 
e) With (17.54): gwu(z) = ¢%,,(—2) = Ap*,, (—2) = Adu (2) 
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Solution 18.5 

Using (18.21) and (18.7), for uncorrelated signals 2 and y holds 

Puz(t) = A*Pra(z) 

Pyz(z) = B*gyy(z) 

With (18.8) and (18.17), we obtain: 

P22(7) = |AlPax(z) + |B) yyy (<) 

Solution 18.6 


—u)* — 2jw +2 
H(jw) = 2. 
ap ae) (gw + 2)(—w? + 297w + 2) 
Ce ee ee 


~ (4 + w?)((2 — w?)? + dw?) ~ 4+u2 


i} og 
| (jw)|? ns Pan(t) _ 4° 2|t| 


Pn) 


b) Yyy(z) = Yrn(z) * Pux(T) 
Pua(e) = d(t) = Pyy(z) a Prn(T) 


Py = Pyy(0) = Yrn(O) = 1 


Solution 18,7 
a) Pro(gw) = F{yre(c)} = F{d(c)} = 1 


b) tc = 0 (x has zero mean) 
fig = HQ) * tte = 0 


c) Simple calculation of g_r,(z) in the frequency-domain 


Parn(t) = h(z) * A*(—2) 
1?) °° ce) 
. . . 


Pnn(qw) = H(gw) + H*Gw) = |A(jw)/? 
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H(jw) = F{si(t)} = mrect(=) 


Prn{Z) = F-"{nrect(=)} = msi(Z) 


d) Byy(gw) = |H(7w)P®ro(9w) = Wrect(5) 
' 
io] 
Pyy(t) = msilz) 


e) Bgl 2) > Paa(Z) * h*(—r) 
mpl 2) = Pon €) # R"(--r) = 82) #h*(=2) = AY) = si"(—2) = a2) 


f) Power = mean squared= E{|x(t)|?} = gy2(0) 
xx(0) > oo (white noise has infinite power) 
Pre(0) = a7 + LN 
=> Varianz o2 = y,,,(0) = 00 


Pyy(0) = 7, of =n (band-limited white noise has finite power) 


Solution 18.8 


a) Inverse Fourier transform with the shift theorem: 


] a 1) Ta _ 4 tw 
A(jw) = groct(5— Ve" Aw 1. @ 7 2w9 ) 
: an 
12) 


ma) = FE fs(vett + god) +8i(oule— 3) 


b) Likewise, calculation of gpp(z) can be achieved with the shift theorem: 


‘ * a 
|H (gw)|? = cos (5 aE ee) - 
f 
i 1 [ero Ge ee) rect) -_ 
AL ig 
ry , . 1 I pew Ww 
Xe) es ~+-¢ 7% t 
fie — of ae ee Sq) 
lw, . lwy a 
Gale) Gp ella an) mene) tg ee a) 
mm 


c) Yue (TZ) = F*{Gr5(w)} > No d(z) soe 


9 . Verh 
ie = lim Paux(t) Sie 
T 00 27 
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556 
m m 
1 ie bes ( = See — ae 
d) fly = ps HO) a L on 
5 9, Wau Ww 
Dyy(Ie2) = Bre(g2) [A (gu)? = No cos’ F~ proct( 5) +m Ll)? 6(e) 
_ Wy we aa aes 
: ss 
Oo 
No sin(wyt m 
Pyy(Z) = Purr T) * pan(7) = 5 ; : a 27 
i (at |. = 
wyNy om 
Py = Pyy(0) = = on 
Solution 18.9 
ACF; ; 
lta 1 
H(jw)? = oo 
Ow)" = Gay oak ~ PEA 


: i 1 No , 
P yy) = |H (90)? Bax () = Noy ¢ 0 Pyy(2) = het 
Mean: ply = Yyy(t — oc) = 0 


Variance: 02 = yy, (0) — 12 = i 
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Solution 18.10 


en? a 2a 
a) Dyy lt T= = Nae Tl ig a Ojo Nos we a aD = #1, (gw) 
pete 5 a alti a a 
By (90) = i) Beo(ge) > |H(w)? = Hs) = 


b) No, any number of all-pass stages will still not change |H(jw)|?. 


Solution 18.11 
a) With (18.38) and (18.39): 
Pury (T) = Phray (2) * Pre (7) = hi(z) * AT(—Z) * Geo (Z) 
foc ies * Para (T) = ha(t) * h3(—7) * Pua (Z) 


Pyrx( . ae * f(z) 

Pyaie( ere z) * ha(z) 
c) pul r= yo and y = yy in (18.65): 

Pinal) = Peye(2)*ha(2) = Ghye(—2) ha (2) = phe(—2) #h§(—2) #hy(2) = 
= Pur (t) * hj (—c) * hi(z) 

We used (17.54) and (17.58) to rearrange the equations. 

Solution 18.12 

Proceed as in Sec. 18.2.4: 


Prylk] = Eafe +a] 0A" e*[k — W)} = Soh" [WlE{a[k + w]e*[k — ul} = 
lt ub 
= by h* [HiPen [k + 4] 
fe 
Sul Se —jt 


Paylh = Potlh Y) Punl — ¥] = Peele] + h* [1] 


Solution 18.13 
Proceed as 1n Sec. 18.2.3: 


{Mob [kK+K—p ea piste vi} = 
doe lela Bfalk-+ «—ple*[k -v]} = 
DOE Aue] Peele — peo 


bop 


6 
nd 
< 
zx 

tooo 


I\ 
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Substituting ¥ = 4 — v and swapping the sums yield 
on ‘| = 


Pulk] = SCAR |p - 8] - veal 


YD fb 


Yanl[K — V] _ 
» hf) *« h* [—?] * Poy [Kc a, 0) = 
-> Panld 


Der |[K [x —O = Phalh] * Poel | 
Solution 18.14 


a) Difference equation: s[k] = n[k] + 0.9s|k 


9s[k — 1] 
in the BOE: -domain: S{z) = N(z} +0.9271N(z) 
S(z 1 


~ NG) 1 


1—-0.9:-! 2-09 
19) 
GQ . 
a at a eJ2 _ 0.9 
JO |2 1 
ja FQ le | a 
b) ®,.(e% = |H(e Me ®,,(e"") = jes? 0.9/2 ~  Jer® — 0.92 
100 to ae ee T i | RO ee (en aa | 
Bol | 
\ 
ae 60 \ 
a \ 
G 407 \ 4 
x= x 
20+ Xe 5 
) oe - td 
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 
Qt ——— 
Solution 18.15 
a) Ic 


yy(Jw) of the received signal y(t) and the cross-spectrum ®,,(jw) between 
is: 


) To determine the Wiener filter we need to know the power density spectrum 
(t) and the transmitted signal a(t). 'The optimal solution to this exercise 


_ Boyle) 
By (gw) Dyy (qw) 


b) Read the linear distortion without noise = H(jw) = 


from the block diagramm: G(s) 


G(gw) 
1 as +6 
Boe 
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2 jw qw 
a IL = Se 
(yw) gw:atb jgw+100 
iio. J 
Dyy(w) a IG(gw)|? Bi (Jw) ee Ee Al ) 
b5e(gw) = |H(qw)|? - |@(qw)? » Px2(gw) = Pre (gw) 
DJ) = P 3g) (ico) = | Gyo)! |G)! 


104 + wv? 


1 104 aie “ 
fresno Se i 107 <f 
107 1 «10 10° @ 107-2 4 20774 a0? 10 
Before sketching the Bode plots, the zeros and poles of |G(s)|? are deter- 


mined: s,, = +10° and s, = 0. The zeros have the combined effect of a 
double zero at —10?. 


c) Linear distortion and additive noise 


Dre (jw)G* (jw) 
=> A(qw)= 
1) =F GulGGuyl? + Onnlge) 
€fary we Ais 
Hoe G*(qw) + 1007 


IGQw)|? +. No ~~ 104 (w? + 1) 


Pea(qw) = [Pra (gw) . IG (gw)? nae fo] ‘ |H(qw)|? 


2. 194 4 4,2 2 194 
_ [22 +10" | ogg] ett 10tw? iw +10 
we 108 (w2 +1)? 104 (w? + 1) 


D, ya) *| G(jeo)|? |HQo@)| Pz) 


1072: Nas ahs 
1 = - : » 10-4 - 
10-2 1 10? 10 w 107 1 «102 10% w 102 1 40? 104 w& 


Solution 18.16 

Calculation of ®. (yw): 

According to (18.22), ®,,(gw) = ®..(qw), since s(t) and n(t) are uncorrelated. 
Don (gu) = ®,, (gw): G* (gw) = ®..(gw) - G* (gw), according to (18.67) 
Calcuation of ®,.(gw): 

Por(Jw) = &,,(gw) + |G(gw)|? = (Onn (gw) + &ss(gw)) |G(qw)|? 


Wiener filter: 
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Gay. = See By5(Jw) G* (gw) 
y.(gw) (Par (jw) -+ ®,,(7w)) IG (gw) |? 
jw +10 - 
7 cee for jw| < wy 


0 otherwise 
Solution 18.17 
The noise-free signal at the output is 9(f). 
Pyx(t) = Efy(t+ c)0(é)} = B{[n(t +o) + 9+ a x(t)} = 
= E{n(t+ zr) z(t)} + E{g(é+ 7) e(t)} =0 + vya(z) 


With yrr(z) = d(z) gilt analog zu (18.77), (18 a Pyx(t) == h(c) aud therefore 
D yx (jw) a Pox (gw) = A (jw). 
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Appendix B.1_ Bilateral Laplace Transform Pairs 


a(t) X(s) = L{a(t)} ROC 
6(t) | 1 sec 
1 
e(t) = Re{s} > 0 
ee(t Re(s} > Re{—a} 
e(t ae 248 e{-a 
1 
saat = ry a — 
e~tte(_t) are Re{s} < Re{—a} 
{1 
te(t) ai Re{s} > 0 
tMe(t) 
te~“te(t) : Re{s} > Re{—a} 
(s +a)? 
Pe teh) n! Ri f sb o> R 
oT es (epayet e{s} e{—a} 
wo 
sin(wgtle(t) ae Refs} > 0 
al 8 
08(wyt elt +s ofs} > 
cos(wytje(t) ear Re{s} > 0 
sta 


ec cos(wot}e(t) Re{s} > Re{--a} 


(s +a)? + we 


e~" sin(wolle(t) ea Re{s} > Re{—a} 
: al 


2,2 
8 WH 


(s2 + we)? Re{s} > 0 


2Wys ; 
{s? ae we)? Re{s} > O 


t cos(wolje(e) 


tsin(wotje(t) 
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Appendix B.2. Properties of the Bilateral Laplace 


Transform 
a(t) | X(s} = L{a(t)} ROC 
Linearity ea, = 
Ar () 1; Be: (t) AX (8) ag BX2(s) ROC{X)} 
ek: : AROC{ Xe} 
Delay 
we - A e*=X(s) not affected 
Modulation Ks 2a) Refa} shifted by 
etta(l) oo Re{a} to the right 
‘Multiplication by t, 
Dulicrenianion. in the a X(s) jot atsiad 
frequency domain ds 
ta(t) 
Differentiation in the ae 
time domain ROC = 
- os) ROCLX} 
— x(t) 
dt 
Integrat : 
Perak Ly ) ROC > ROC{X} 
| glcjdz ae A{s:Re{s} > 0} 
FXO 
Sealne | ; ROC scaled by a 
Wane —xX (=) factor of 
x(at) |a| a : 
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Appendix B.3 Fourier Transform Pairs 


x(t) X (gw) = F{x(t)} 
d(t) 1 
1 277d (uw) 
d(t) ju 
Enna Mee 
T as 20 
2(!) lw) +4 — 
ee TOU Jw 
1 w 
rect(at) ae (=) 
; mT fw 
si(at) ja (=) 
1 : 
. —jrsign(w) 
sign(t) cs 
jw 
elwot 2775 (w — wy) 
cos(wot) T|d(w + wo) + 6(w — wo)] 
sin(wot) gm [d(w + wo) — 6(w — wo)| 
e-Alll, a > 0 Eanes 
a? + w? 
e at? Va 2 
ra 


rn 
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Appendix B.4 Properties of the Fourier Trans- 


form 
iF a(t) X(qw) = Fia(t)} 
——_] 
Linearity Ax (t) + Bag(t) AX) (gw) + BXo(qw) 
Delay a(t — z) eI# EX (yw) 
Modulation et a(t) | X(y(w — wo)) 
‘Multiplication by ? 
A AX (4 

Differentiation in the tx(£) ee) 

en ele d(qw) 
frequency domain 
Differentiation in the dx(t) yu X (qu) 
time domain dl 


Integration 


Scaling zat) | 


de x(rjdr 


X(qw) |=5(e) + a 


Jw 


I 


1X (yw) + rX(0)5(w) 
QW 


ay (=) . ae R\{0} 


Convolution 


“Ly (t) * xro(t) 


X1 (gw) + Xo(jw) 


1 . 
——Xy(gw) * Xo(gw) 


Multiplication vy (t) » eo(t) on 
te x, (t) &o(jw) 
Duality t2(9t) 24:1 (—w) 
a(—t) X(—jw) 
Symmetry relations x*(t) Xj) 
x*(—£) X* (gu) 


Parseval theorem 


Qn 


— f  |X(w) Pa 


ral 
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Appendix B.5 Two-sided z-Transform Pairs 


— 


J 
alk A(2) = 2 {2[k]} ROC 
olk 1 2 EC 
e|k L < i [z| > 1 
a” e[k| - = |s| > la 
—a'e[-k — 1| ‘ = 4 Iz| < |a| 
ke|k = c 
elt can: Is] >4 
— 4 aie 
F az 
ka*e[k Gap |z| > la] 
: esin Qp | 
sin(Qok)e(& Pl 
amlOp eel) 2? — 2 cosQy) +1 ene 
z(2 — cos Qo) 
ros(OQgkjelk = a 
cos(onielAl 2? — 22 cosQ +1 age 
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Appendix B.6 Properties of the z-Transform 


Property ik] X(z) ROC 
aie 
| 
ene : ; Bete ROC 2 
Linearity ax, (k]+bare[k] aX (z) + bXo(z) ROC{X,}MROC{ Xp} 
_ 
ROC{z}; separate 
Delay t{k — ki] z* X (2) consideration of 
z=Oand z—- 2 
Modulati horlk xe t= 1/2 
odulation a® ak] Xx (=) ROC { a‘ EROC {x}} 
Multiplication kee [hl dX (2) tele eens 
by k eae |B ae Fe aa eration fe) 
z= 
Time inversion x[—k] X(ze 1) ROC= {z |27'EROC{a}} 


: ; ROC 2D 
Sonvolusions, We Aalels ale] Ake) Kale) ROC{r }|NROC{x9} 
if 
, ed Sa 1. 1 afer multiply the 
Multiplication | 21[k] - 22[k] 5 Xi(€)X2 c ru 


limits of the ROC 
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Appendix B.7 Discrete-Time Fourier Transform 


Pairs 


X (ei) = F,{alk]} 


l= { 4 


O[k 
Elk 
iN 
J 
bss 
; Q-—-QO 
jQok {Btls =) 
‘ ( 27 
1 Q + Qy Q = OQ 
08 Qok -| ) 
C08 % 5 ju oe) + EL | 
F ale 1 + Og Q = Op 
Ook | ut( ) - 4 ) 
ee | On a, 
for O<k<N inte sin( %2) 
sin( ) 


otherwise 


r 
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Appendix B.8 Properties of the Discrete-Time 
Fourier Transform 


[Property a{k] | X (eI) = F,{a[k]} 


= 


Linearity 
( 
L 


ax |k) + baz[k] fox (el) + bX 9(e%) | 


Delay z{k—K] eI X(eI%) REZ 


Modulation eI 2k elk] X (ci(2-0)) Oy € IR 


Convolution x1|k] * v[k] X1(eI%) Xo(ei) 


| 
| Fe GOs 
Multiplication x1 (k] vk] rma (e??)@®X2(e3®) 


1 fF or 
2 foo fe [X(e?®)P aa 
Parseval theorem S| |ar[k]|" ae ee er 


k=—00 one period! 
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DT,-circuit, 179 

P-circuit, 397 

(-lactor, 254 

s-plane, 48, 325, 388 

z-plane, 319, 325, 388 

z-transform, 315, 316, 318, 322 
convolution theorem, 353 
finite sequence, 330 
infinite sequence, 330 
inverse, 328 
of an exponential sequence, 317 
shift theorem, 344 
theorems, 326 

F transform 
convolution property, 308 
modulation property, 308 
multiplication theorem, 309 
shift property, 308 


ACF, see auto-correlation function, 
410 
ADC, see analog-to-digital converter, 
261 
aliasing, 272 
time-domain, 286 
analog-to-digital converter. 261 
analysis 
complex, 87 
spectral, 219 
angular frequency, 298 
angular sampling frequency, 325 
aperture 
correction filter, 282 
function, 281 


rectangular, 281 
auto-correlation, 228, 424 

sequences, 431 
auto-correlation function, 410, 417, 

443 

auto-covariance, 420, 425 
average 

across the process, 405 

along the process, 405 

linear, 407, 442 

quadratic, 407 

statistical, 405 

time, 405 


band-limited 

signal, 271 
band-pass signals 

complex, 275 

real, 276 
bandwidth, 231 
baseband, 271 
baseband spectrum, 271 
basis functions, 269 
BIBO-stability, 383 
bilinear transform, 392 
block diagram, 19, 346 
Bode diagram, 241, 333 


canonical form, 21 

Cauchy integral, 92 

causal, 112 

causality, 367 
characteristic sequence, 316 
complex 
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amplitude, 49, 298 
band-pass signals, 275 
exponential function, 50 
exponential signal, 46 
frequency, 46 
frequency parameter, 48 
frequency plane, 110 
complex amplitude spectrum, 197 
complex analysis, 87 
main principle of, 88 
complex frequency plane, 48 
complex pole pair, 249, 254 
conjugate symmetry, 210 
continuity, 5 
control, 178 
controllability, 36 
controllable. 36, 37 
controllable system, 35 
controller, 396 
convergence, OL 
convolution, 169, 169, 266, 351 
by inspection, 182 
cyclic, 268, 309 
discrete. 309, 350, 352, 356 
periodic, 268 
theorem, 170, 171 
convolution theorem, 217 
correlation function, 417 
correlation functions, 103 
of complex signals, 423 
critical sampling, 273 
cross-correlation, 227, 421, 423 
sequences, 431 
cross-covarlance. 423, 425 
cross-power density spectrum, 426 
cross-spectrumt, 426 
crosscorrealtion function, 445 
cut-off frequency, 243, 248, 251 
cyclic convolution, 268, 309 


damping, 298 
decouvolution, 191 
delay circuit. 176 
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delta impulse, 158, 171, 175, 177, 
297, 351 
calculation rules, 160 
derivative, 162 
linear combination, 161 
derivation, 162, 165 
determinism, 5 
DIT, see discrete Fourier transform, 
286 
difference equation, 340, 344, 348 
analytical solution. 341 
numerical solution, 341 
differential equation, 126 
homogenous solution, 126 
specific solution, 126 
differential equations, 17 
ordinary, 18 
partial, 18 
with constant coefficients. 18 
differentiation theorem, 77, 79, 80 
differentiator, 27, 175 
digital signal, 261, 296 
dimensionality, 5 
Dirac delta function, 158 
Dirac impulse, 158 
direct form I], 20, 346 
direct. form IT, 20, 346 
direct Form III, 24 
discrete convolution, 309, 350, 352, 
356 
discrete delay circuit. 344 
discrete Fourier transtorm, 286 
discrete step function, 298 
discrete system, 339 
discrete unit impulse, 297, 302 
discrete wit step function, 303 
discrete-time Fourier ltransform, 301 
discrete-time signal, 295 
discrete-time systems. 339 
listribulion, 158 
domain, 5 
duality, 215 
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eigenfunction, 48, 51-33 
cigensequence, 341 
energy of a time signal, 226 
ensemble, 404 
ensemble mean, 405 
ergodic, 441 
joint. 422 
weak, 415 
ergodic random processes, 414 
error power. 453 
estimation error, 453 
even function, 209 
even sequence, 310 
expected value, 5, 403, 405 
second-order joint, 421 
expected values 
first-order, 407 
second-order, 410 
exponential function, 52 
exponential order, 72 
exponential sequence, 317, 319 
unilateral, 304 
exponential sequences, 298 
uudamped. complex, 302 
external part, 128, 144, 341 


F, transform, 301. 322 
I,. transformizverse, 301 
feedback, 398 
filter 
auto-correlation function, 444 
matched, 188 
optimal, 453 
Wicner, 191, 452, 453 
filter ACF, 444 
FIR-system. 356 
Fourier 
cocfficients, 266 
Fourier series, 61, 261 
Fourier spectrum, 197 
Fourier transform, 61, 196, 197. 200, 
241, 322 
convolution, 217 
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differentation theorem, 224 
discrete. 286 
discrete-time, 301 
duality, 215, 269 
integration theorem, 224 
inverse, 213 
inverse diserctc-time, 301 
linearity, 215 
modulation, 221 
multiplication, 219 
of a sequence, 301, 322 
pairs, 200 
periodic signals, 264 
shift, 221 
similarity, 217 
frequency 
resonant, 254 
frequency parameter, complex. 48 
frequency resolution, 309 
frequency response. 241, 333 
snoothing, 396 
frequency, complex, 46 
frequency-domain, 45, 285 
function 
analytic, 69, 88 
complex differentiable, 69 
even, 209 
holomorphic, 69 
odd, 209 
regular, 69 


Gauss impulse, 234 


Hilbert transform, 372 
Hurwitz 
determinants, 392 
polynomial, 392 


J-cireuit, 179 

IIR-system, 356 

impedance, 53 

impulse response, 160, 167, 174 
390. 351, 369 
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impulse train, 177, 261 
indefinite integral. 68 
initial condition, 19 
natural, 129 
inilial condition problem, 19, 125, 
341, 348 
classical solution, 126 
first-order, 135 
with sinusoidal signal, 132 
initial state, 129, 142 
initial value, 129, 142 
integrable, 384 
integration theorem, 77, 79 
integrator, 28, 174 
internal part, 128, 144, 341 
interpolation filter, 271 
intial state, 143 
inversion, 395 


Laplace integral, 64 
Laplace Transform 
inverse bilateral, 97 
Laplace transform, 61, 62, 64-66, 70. 
72, 195, 198, 322, 324 
bilateral, 61, 79 
differentiation theorem, 77. 175 
existence ol, 72 
integration theorem, 77, 175 
iiverse, 62, 73, 87, 98 
inverse unilateral, 96 
inverse with completing the 
square, 102 
modulation theorem, 76 
practical calculation of the in- 
verse, 101 
properties, 75 
shift theorem, 76, 177 
unilateral, 61, 63, 79 
Laurent expansion, 69 
line spectrum, 264, 266 
linearity, 7 
low-pass filter 
ideal, 386 


LTI-system, 10, 50, 369 
causal stable, 388 
combination, 115 
discrete, 340 
feedback, 117 
parallel coupling, 116 
series coupling, 115 

LT I-systems 
combination, 179 


magnitude frequency response, 242 
magnitude spectrum, 197 
matched filter, 188 
matrix 

Frobenius, 33 

modal, 34 

system, 33 

transformation, 33 
mean, 5 
mean square, 427, 445 
measurement, 

of the impulse response, 451 

of the transfer function, 451 
modal matrix, 34 
modulation, 222 
modulation theorem, 76, 221, 327 
multiplication property, 219 
multiplication theorem, 327 


noise power, 404 
normalisation, 54 
Nyquist frequency, 273 


observability, 36 
observable. 36 
completely, 37 
observable system, 35 
observation 
window of, 220 
odd function, 209 
odd sequence, 310 
operational amplifier, 28 
optimal filter, 453 
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order of a system, 111 
output equation, 31 
oversampling, 273 


P-circuit, 179 
parallel form, 34 
Parseval relationship, 310 
Parseval’s theorem, 225, 235 
partial fraction expansion, 98 
for multiple poles, 103 
path 
direct, 31 
periodic convolution, 268 
periodic signal, 261, 264 
phase, 197 
phase spectrum, 197 
Pl-circuit, 179 
pole, 64, 67, 69, 110 
pole pair, complex, 249, 254 
pole-zero diagram, 110, 241, 332, 333 
power, 407, 445 
power density spectrum, 447 
PTy-circuit, 179 


quantisation, 296 
amplitude, 261 
time, 261 


random process, 404 
random sequences, 431 
random signal 
addition, 438 
multiplication with a factor, 437 
real band-pass signal, 276 
realisation, 404 
reconstruction, 282 
of a signal, 452 
rectangle function, 201, 202, 204 
rectangle impulse, 155, 202 
region of convergence, 62, 64- 66, 70, 
112, 170, 315, 353, 388 
of the z-transform, 320 
residue theorem, 91 


resonance curve, 254 
resonant frequency, 254 
rms, 445 

ROC, 62 

root locus, 397 


sample function, 404 
sample-and-hold, 282 
sampling, 261, 269, 295, 376 
critical, 273, 376 
frequency-domain, 285 
ideal, 269 
ceal world, 279 
sampling frequency, 269 
sampling rate, 272 
sampling theorem, 270, 325 
selective property, 159, 297 
sequence 
even, 310 
odd, 310 
sha-symbol, 262 
shift theorem, 76, 221, 327 
si-function, 203 
signal, 1 
amplitude, 1 
amplitude-continuous, 5 
amplitude-discrete, 5 
analogue, 5 
analytical, 376 
band-limited, 271 
causal, 370 
complex band-pass, 275 
continuous, 1, 4 
continuous-time, | 
deterministic, 4, 5, 403 
digital, 5, 261, 296 
discontinuous, 5 
discrete, 2 
discrete-time, 2, 295 
multidimensional, 4, 5 
one-dimensional, 4, 5 
periodic, 261, 264 
piecewise continuous, 80 
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real band-pass, 276 
reconstruction of, 452 
stochastic, 4, 404 
similarity theorem, 217, 327 
singularity, 69, 89, 90 
essential, 69 
spectral analysis, 219 
spectrum, 219, 220, 371 
baseband, 271 
complex amplitude, 197 
Fourier, 197 
magnitude, 197 
of a sequence, 301 
one-sided, 374 
phase, 197 
power density, 447 
stabilising, 396 
stability, 367, 383 
BIBO-, 383 
continuous systems, 389 
discrete systems, 390, 393 
Hurwitz criteria, 391 
stability criteria . 385 
state, 29 
-matrix, 33 
-variable, 29 
equation, 31 
state-space 
description, 142 
differential equation, 138 
representation, 347 
stationary, 412, 441 
joint, 422 
weak. 413 
statistical average, 405 
step function, 63, 64, 65, 164, 174 
derivation, 165 
step response, 108, 174 
superposition principle, 8, 308, 339 
symunetry 
conjugate, 210 
system, 5 
causal. 13, 112, 367 
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classification, 13 
discrete, 339 
discrete-time, 339 
equivalent, 37 
FIR-, 356 
function, 50 
TR-, 356 
inversion, 395 
linear, 7, 339 
matrix, 31, 34 
memory, 13 
memoryless, 13 
minimal phase, 395 
non-recursive, 356 
nonlinear, 7 
recursive, 356 
response, 53 
shift-invariant, 340 
stabilising, 396 
time mmvariant, 9. 12 
tine vaniant, 12 
time-invariant, 7, 340 
translation-invariant, 13 
system analysis, 107 
system function, 105, 107, 169, 343 
rational fraction, 110 
system identification, 107 
system matrix, 33 
system state, 125 


time average, 405 
time invariance, 7, 9 
time reversal, 327 
time series, 295 
time-average, 431 
second-order joint, 422 
time-bandwidth product, 231, 233 
time-domain aliasing, 286 
tolerance scheme. 233 
transfer function, 50, 105, 348 
inverse. 118 
transform 
z-, $15 
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-F, . 301 

bilinear, 392 

Fourier, 61, 196 

Hilbert, 372 

Laplace, 61, 62, 195 
transform pairs 

of the Laplace transform, 83 
transformation 

to parallel form, 36 
transformation matrix, 33, 139 


uncertainty relation, 236 

uncorrelated. 418 

undersampling, 273 

uniqueness, 73 

unit circle, 388 

unit impulse, 158, 297 
diserete. 302 


variable 
continuous, 2 
dependent, 1 
independent, 1 

variance, 5, 407 


white noise, 429 
band-limited, 430 
Wiener filter, 191, 452. 453 
window of observation, 220 


zero, L10 
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